{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T21:17:14Z","timestamp":1764364634831,"version":"build-2065373602"},"reference-count":84,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,8,9]],"date-time":"2022-08-09T00:00:00Z","timestamp":1660003200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"French National Research Agency (ANR)","award":["EUR MANUTECH SLEIGHT-ANR-17-EURE-0026"],"award-info":[{"award-number":["EUR MANUTECH SLEIGHT-ANR-17-EURE-0026"]}]},{"name":"French Ministry of Higher Education and Research","award":["EUR MANUTECH SLEIGHT-ANR-17-EURE-0026"],"award-info":[{"award-number":["EUR MANUTECH SLEIGHT-ANR-17-EURE-0026"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>A self-organization hydrodynamic process has recently been proposed to partially explain the formation of femtosecond laser-induced nanopatterns on Nickel, which have important applications in optics, microbiology, medicine, etc. Exploring laser pattern space is difficult, however, which simultaneously (i) motivates using machine learning (ML) to search for novel patterns and (ii) hinders it, because of the few data available from costly and time-consuming experiments. In this paper, we use ML to predict novel patterns by integrating partial physical knowledge in the form of the Swift-Hohenberg (SH) partial differential equation (PDE). To do so, we propose a framework to learn with few data, in the absence of initial conditions, by benefiting from background knowledge in the form of a PDE solver. We show that in the case of a self-organization process, a feature mapping exists in which initial conditions can safely be ignored and patterns can be described in terms of PDE parameters alone, which drastically simplifies the problem. In order to apply this framework, we develop a second-order pseudospectral solver of the SH equation which offers a good compromise between accuracy and speed. Our method allows us to predict new nanopatterns in good agreement with experimental data. Moreover, we show that pattern features are related, which imposes constraints on novel pattern design, and suggest an efficient procedure of acquiring experimental data iteratively to improve the generalization of the learned model. It also allows us to identify the limitations of the SH equation as a partial model and suggests an improvement to the physical model itself.<\/jats:p>","DOI":"10.3390\/e24081096","type":"journal-article","created":{"date-parts":[[2022,8,10]],"date-time":"2022-08-10T02:42:53Z","timestamp":1660099373000},"page":"1096","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Learning PDE to Model Self-Organization of Matter"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7146-8255","authenticated-orcid":false,"given":"Eduardo","family":"Brandao","sequence":"first","affiliation":[{"name":"Laboratoire Hubert Curien UMR5516, UJM-Saint-Etienne, CNRS, IOGS, Universit\u00e9 de Lyon, F-42023 St-Etienne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8462-7019","authenticated-orcid":false,"given":"Jean-Philippe","family":"Colombier","sequence":"additional","affiliation":[{"name":"Laboratoire Hubert Curien UMR5516, UJM-Saint-Etienne, CNRS, IOGS, Universit\u00e9 de Lyon, F-42023 St-Etienne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0374-3814","authenticated-orcid":false,"given":"Stefan","family":"Duffner","sequence":"additional","affiliation":[{"name":"CNRS, INSA-Lyon, LIRIS, UMR5205, Universit\u00e9 de Lyon, F-69621 Villeurbanne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R\u00e9mi","family":"Emonet","sequence":"additional","affiliation":[{"name":"Laboratoire Hubert Curien UMR5516, UJM-Saint-Etienne, CNRS, IOGS, Universit\u00e9 de Lyon, F-42023 St-Etienne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4557-8677","authenticated-orcid":false,"given":"Florence","family":"Garrelie","sequence":"additional","affiliation":[{"name":"Laboratoire Hubert Curien UMR5516, UJM-Saint-Etienne, CNRS, IOGS, Universit\u00e9 de Lyon, F-42023 St-Etienne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3038-9347","authenticated-orcid":false,"given":"Amaury","family":"Habrard","sequence":"additional","affiliation":[{"name":"Laboratoire Hubert Curien UMR5516, UJM-Saint-Etienne, CNRS, IOGS, Universit\u00e9 de Lyon, F-42023 St-Etienne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0653-0710","authenticated-orcid":false,"given":"Fran\u00e7ois","family":"Jacquenet","sequence":"additional","affiliation":[{"name":"Laboratoire Hubert Curien UMR5516, UJM-Saint-Etienne, CNRS, IOGS, Universit\u00e9 de Lyon, F-42023 St-Etienne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6993-9505","authenticated-orcid":false,"given":"Anthony","family":"Nakhoul","sequence":"additional","affiliation":[{"name":"Laboratoire Hubert Curien UMR5516, UJM-Saint-Etienne, CNRS, IOGS, Universit\u00e9 de Lyon, F-42023 St-Etienne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6851-169X","authenticated-orcid":false,"given":"Marc","family":"Sebban","sequence":"additional","affiliation":[{"name":"Laboratoire Hubert Curien UMR5516, UJM-Saint-Etienne, CNRS, IOGS, Universit\u00e9 de Lyon, F-42023 St-Etienne, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1103\/RevModPhys.65.851","article-title":"Pattern Formation Outside of Equilibrium","volume":"65","author":"Cross","year":"1993","journal-title":"Rev. Mod. Phys."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.actamat.2020.04.058","article-title":"High-Frequency Periodic Patterns Driven By Non-Radiative Fields Coupled With Marangoni Convection Instabilities on Laser-Excited Metal Surfaces","volume":"194","author":"Rudenko","year":"2020","journal-title":"Acta Mater."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"041914","DOI":"10.1063\/1.2834902","article-title":"Colorizing metals with femtosecond laser pulses","volume":"92","author":"Vorobyev","year":"2008","journal-title":"Appl. Phys. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2711","DOI":"10.1016\/j.actbio.2010.01.016","article-title":"Tuning cell adhesion by controlling the roughness and wettability of 3D micro\/nano silicon structures","volume":"6","author":"Ranella","year":"2010","journal-title":"Acta Biomater."},{"key":"ref_5","first-page":"9000615","article-title":"Laser-induced periodic surface structures\u2014A scientific evergreen","volume":"23","author":"Bonse","year":"2016","journal-title":"IEEE J. Sel. Top. Quantum Electron."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1515\/aot-2019-0062","article-title":"Formation of laser-induced periodic surface structures on different materials: Fundamentals, properties and applications","volume":"9","year":"2020","journal-title":"Adv. Opt. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1016\/j.apsusc.2015.10.102","article-title":"Femtosecond laser surface texturing of titanium as a method to reduce the adhesion of Staphylococcus aureus and biofilm formation","volume":"360","author":"Cunha","year":"2016","journal-title":"Appl. Surf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"033103","DOI":"10.1063\/1.4905616","article-title":"Multifunctional surfaces produced by femtosecond laser pulses","volume":"117","author":"Vorobyev","year":"2015","journal-title":"J. Appl. Phys."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3012","DOI":"10.1021\/la104607g","article-title":"Bacterial retention on superhydrophobic titanium surfaces fabricated by femtosecond laser ablation","volume":"27","author":"Fadeeva","year":"2011","journal-title":"Langmuir"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"10112","DOI":"10.1038\/s41598-018-28454-2","article-title":"Towards Laser-Textured Antibacterial Surfaces","volume":"8","author":"Lutey","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2913","DOI":"10.1364\/OE.18.002913","article-title":"Controlled nanostructrures formation by ultra fast laser pulses for color marking","volume":"18","author":"Dusser","year":"2010","journal-title":"Opt. Express"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7625","DOI":"10.1016\/j.apsusc.2012.04.105","article-title":"Selective appearance of several laser-induced periodic surface structure patterns on a metal surface using structural colors produced by femtosecond laser pulses","volume":"258","author":"Yao","year":"2012","journal-title":"Appl. Surf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"16095","DOI":"10.1038\/ncomms16095","article-title":"Laser-induced plasmonic colours on metals","volume":"8","author":"Guay","year":"2017","journal-title":"Nat. Commun."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6479","DOI":"10.1039\/C5TC00553A","article-title":"Well-designed metal nanostructured arrays for label-free plasmonic biosensing","volume":"3","author":"Li","year":"2015","journal-title":"J. Mater. Chem. C"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1219","DOI":"10.3390\/mi5041219","article-title":"Fabrication of micro\/nano structures on metals by femtosecond laser micromachining","volume":"5","author":"Ahmmed","year":"2014","journal-title":"Micromachines"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"8485","DOI":"10.1038\/s41598-017-08788-z","article-title":"High-speed manufacturing of highly regular femtosecond laser-induced periodic surface structures: Physical origin of regularity","volume":"7","author":"Gnilitskyi","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"6609","DOI":"10.1039\/C9NR09625F","article-title":"Sub-100 Nm 2d Nanopatterning on a Large Scale By Ultrafast Laser Energy Regulation","volume":"12","author":"Rudenko","year":"2020","journal-title":"Nanoscale"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Nakhoul, A., Maurice, C., Agoyan, M., Rudenko, A., Garrelie, F., Pigeon, F., and Colombier, J.P. (2021). Self-Organization Regimes Induced By Ultrafast Laser on Surfaces in the Tens of Nanometer Scales. Nanomaterials, 11.","DOI":"10.3390\/nano11041020"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2200761","DOI":"10.1002\/advs.202200761","article-title":"Boosted Spontaneous Formation of High-Aspect Ratio Nanopeaks on Ultrafast Laser-Irradiated Ni Surface","volume":"9","author":"Nakhoul","year":"2022","journal-title":"Adv. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2001). The Elements of Statistical Learning, Springe.","DOI":"10.1007\/978-0-387-21606-5"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1038\/nature16961","article-title":"Mastering the game of Go with deep neural networks and tree search","volume":"529","author":"Silver","year":"2016","journal-title":"Nature"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10701-012-9691-3","article-title":"Forty years of string theory reflecting on the foundations","volume":"43","author":"Dieks","year":"2013","journal-title":"Found. Phys."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1038\/s42254-021-00314-5","article-title":"Physics-informed machine learning","volume":"3","author":"Karniadakis","year":"2021","journal-title":"Nat. Rev. Phys."},{"key":"ref_24","unstructured":"Willard, J., Jia, X., Xu, S., Steinbach, M., and Kumar, V. (2020). Integrating physics-based modeling with machine learning: A survey. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3447814","article-title":"Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profiles","volume":"2","author":"Jia","year":"2021","journal-title":"ACM\/IMS Trans. Data Sci."},{"key":"ref_26","unstructured":"Um, K., Brand, R., Fei, Y.R., Holl, P., and Thuerey, N. (2020, January 6\u201312). Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solvers. Proceedings of the Annual Conference on Neural Information Processing Systems, Virtual."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yu, R., Perdikaris, P., and Karpatne, A. (2021, January 14\u201318). Physics-Guided AI for Large-Scale Spatiotemporal Data. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual Event, Singapore.","DOI":"10.1145\/3447548.3470793"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1103\/PhysRevA.15.319","article-title":"Hydrodynamic fluctuations at the convective instability","volume":"15","author":"Swift","year":"1977","journal-title":"Phys. Rev. A"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"042036","DOI":"10.1103\/PhysRevResearch.2.042036","article-title":"Labyrinthine Patterns Transitions","volume":"2","author":"Clerc","year":"2020","journal-title":"Phys. Rev. Res."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tarantola, A. (2005). Inverse Problem Theory and Methods for Model Parameter Estimation, SIAM.","DOI":"10.1137\/1.9780898717921"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"e535","DOI":"10.1002\/wcc.535","article-title":"Data Assimilation in the Geosciences: An Overview of Methods, Issues, and Perspectives","volume":"9","author":"Carrassi","year":"2018","journal-title":"Wiley Interdiscip. Rev. Clim. Chang."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1111\/1467-9868.00294","article-title":"Bayesian Calibration of Computer Models","volume":"63","author":"Kennedy","year":"2001","journal-title":"J. R. Stat. Soc. Ser. Stat. Methodol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3801","DOI":"10.1007\/s11831-021-09539-0","article-title":"A Survey of Bayesian Calibration and Physics-Informed Neural Networks in Scientific Modeling","volume":"28","author":"Viana","year":"2021","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"124012","DOI":"10.1088\/1742-5468\/ac3ae5","article-title":"Augmenting Physical Models With Deep Networks for Complex Dynamics Forecasting","volume":"2021","author":"Yin","year":"2021","journal-title":"J. Stat. Mech. Theory Exp."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1038\/s41566-018-0246-9","article-title":"Inverse Design in Nanophotonics","volume":"12","author":"Molesky","year":"2018","journal-title":"Nat. Photonics"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"B182","DOI":"10.1364\/PRJ.415960","article-title":"Deep Learning in Nano-Photonics: Inverse Design and Beyond","volume":"9","author":"Wiecha","year":"2021","journal-title":"Photonics Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1038\/s41566-020-0685-y","article-title":"Deep Learning for the Design of Photonic Structures","volume":"15","author":"Ma","year":"2021","journal-title":"Nat. Photonics"},{"key":"ref_38","unstructured":"Filoche, A., Brajard, J., Charantonis, A.A., and B\u00e9r\u00e9ziat, D. (2020, January 12). Completing physics-based models by learning hidden dynamics through data assimilation. Proceedings of the NeurIPS 2020, Workshop on AI4Earth, Vancouver, BC, Canada."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3067","DOI":"10.1002\/qj.4116","article-title":"Using Machine Learning To Correct Model Error in Data Assimilation and Forecast Applications","volume":"147","author":"Farchi","year":"2021","journal-title":"Q. J. R. Meteorol. Soc."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Nguyen, D., Ouala, S., Drumetz, L., and Fablet, R. (2020, January 4\u20138). Assimilation-based learning of chaotic dynamical systems from noisy and partial data. Proceedings of the ICASSP 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9054718"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"20200086","DOI":"10.1098\/rsta.2020.0086","article-title":"Combining Data Assimilation and Machine Learning To Infer Unresolved Scale Parametrization","volume":"379","author":"Brajard","year":"2021","journal-title":"Philos. Trans. R. Soc. A"},{"key":"ref_42","unstructured":"D\u00e9chelle, M., Don\u00e0, J., Plessis-Fraissard, K., Gallinari, P., and Levy, M. (2020, January 12). Bridging Dynamical Models and Deep Networks to Solve Forward and Inverse Problems. Proceedings of the NeurIPS workshop on Interpretable Inductive Biases and Physically Structured Learning, Vancouver, BC, Canada."},{"key":"ref_43","unstructured":"Greydanus, S., Dzamba, M., and Yosinski, J. (2019). Hamiltonian Neural Networks. Adv. Neural Inf. Process. Syst., 32."},{"key":"ref_44","unstructured":"Chen, Z., Zhang, J., Arjovsky, M., and Bottou, L. (2019). Symplectic Recurrent Neural Networks. arXiv."},{"key":"ref_45","unstructured":"Cranmer, M., Greydanus, S., Hoyer, S., Battaglia, P., Spergel, D., and Ho, S. (2020). Lagrangian Neural Networks. arXiv."},{"key":"ref_46","unstructured":"Dona, J., D\u00e9chelle, M., Gallinari, P., and Levy, M. (2022, January 25\u201329). Constrained Physical-Statistics Models for Dynamical System Identification and Prediction. Proceedings of the International Conference on Learning Representations (ICLR), Virtual."},{"key":"ref_47","unstructured":"Beucler, T., Rasp, S., Pritchard, M., and Gentine, P. (2019, January 14). Achieving Conservation of Energy in Neural Network Emulators for Climate Modeling. Proceedings of the ICML 2019 Workshop. Climate Change: How Can AI Help?, Long Beach, CA, USA."},{"key":"ref_48","unstructured":"Beucler, T., Pritchard, M., Yuval, J., Gupta, A., Peng, L., Rasp, S., Ahmed, F., O\u2019Gorman, P.A., Neelin, J.D., and Lutsko, N.J. (2021). Climate-Invariant Machine Learning. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1109\/72.712178","article-title":"Artificial neural networks for solving ordinary and partial differential equations","volume":"9","author":"Lagaris","year":"1998","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","article-title":"Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations","volume":"378","author":"Raissi","year":"2019","journal-title":"J. Comput. Phys."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Breen, P., Foley, C., Boekholt, T., and Portegies Zwart, S. (2019). Newton vs the machine: Solving the chaotic three-body problem using deep neural networks. arXiv.","DOI":"10.1093\/mnras\/staa713"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1016\/0375-9601(80)90568-X","article-title":"Wavelength selection in cellular flows","volume":"75","author":"Pomeau","year":"1980","journal-title":"Phys. Lett. A"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Leveque, R. (2007). Finite Difference Methods for Ordinary and Partial Differential Equations: Steady-State and Time-Dependent Problems (Classics in Applied Mathematics), Classics in Applied Mathematics, SIAM, Society for Industrial and Applied Mathematics.","DOI":"10.1137\/1.9780898717839"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/0375-9601(90)90092-3","article-title":"Construction of Higher Order Symplectic Integrators","volume":"150","author":"Yoshida","year":"1990","journal-title":"Phys. Lett. A"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Hall, B.C. (2003). The Baker-Campbell-Hausdorff Formula. Lie Groups, Lie Algebras, and Representations, Springer.","DOI":"10.1007\/978-0-387-21554-9"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1137\/0705041","article-title":"On the construction and comparison of difference schemes","volume":"5","author":"Strang","year":"1968","journal-title":"SIAM J. Numer. Anal."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1090\/S0025-5718-1965-0178586-1","article-title":"An algorithm for the machine calculation of complex Fourier series","volume":"19","author":"Cooley","year":"1965","journal-title":"Math. Comput."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Butcher, J.C. (2016). Numerical Methods for Ordinary Differential Equations, John Wiley & Sons.","DOI":"10.1002\/9781119121534"},{"key":"ref_59","unstructured":"Hendrycks, D., and Gimpel, K. (2016). Gaussian error linear units (gelus). arXiv."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_61","unstructured":"Bengio, Y., and LeCun, Y. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR, San Diego, CA, USA. Conference Track Proceedings."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_63","unstructured":"Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F.A., and Brendel, W. (2018). ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness. arXiv."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Ferguson, M., Ak, R., Lee, Y.T.T., and Law, K.H. (2017, January 11\u201314). Automatic localization of casting defects with convolutional neural networks. Proceedings of the International Conference on Big Data (Big Data), Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258115"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Lenc, K., and Vedaldi, A. (2015, January 7\u201312). Understanding image representations by measuring their equivariance and equivalence. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298701"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_69","unstructured":"Kanazawa, A., Sharma, A., and Jacobs, D. (2014). Locally scale-invariant convolutional neural networks. arXiv."},{"key":"ref_70","unstructured":"Marcos, D., Kellenberger, B., Lobry, S., and Tuia, D. (2018). Scale equivariance in CNNs with vector fields. arXiv."},{"key":"ref_71","unstructured":"Worrall, D.E., and Welling, M. (2019). Deep scale-spaces: Equivariance over scale. arXiv."},{"key":"ref_72","unstructured":"Ghosh, R., and Gupta, A.K. (2019). Scale steerable filters for locally scale-invariant convolutional neural networks. arXiv."},{"key":"ref_73","first-page":"2990","article-title":"Group Equivariant Convolutional Networks","volume":"Volume 48","author":"Balcan","year":"2016","journal-title":"Proceedings of the 33rd International Conference on Machine Learning"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"374","DOI":"10.3390\/make3020019","article-title":"On the Scale Invariance in State of the Art CNNs Trained on ImageNet","volume":"3","author":"Graziani","year":"2021","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_75","unstructured":"Chollet, F. (2021). Deep Learning with Python, Manning Publisher. [2nd ed.]."},{"key":"ref_76","unstructured":"Lu, J.R. (2011). Azimuthally averaged radial profile."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"e103","DOI":"10.7717\/peerj-cs.103","article-title":"SymPy: Symbolic computing in Python","volume":"3","author":"Meurer","year":"2017","journal-title":"PeerJ Comput. Sci."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Fernando, B., Habrard, A., Sebban, M., and Tuytelaars, T. (2013, January 1\u20138). Unsupervised visual domain adaptation using subspace alignment. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.368"},{"key":"ref_79","first-page":"932","article-title":"Deep hidden physics models: Deep learning of nonlinear partial differential equations","volume":"19","author":"Raissi","year":"2018","journal-title":"J. Mach. Learn. Res."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.jcp.2019.05.024","article-title":"Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data","volume":"394","author":"Zhu","year":"2019","journal-title":"J. Comput. Phys."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1615\/JMachLearnModelComput.2020033905","article-title":"Limitations of physics informed machine learning for nonlinear two-phase transport in porous media","volume":"1","author":"Fuks","year":"2020","journal-title":"J. Mach. Learn. Model. Comput."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"110768","DOI":"10.1016\/j.jcp.2021.110768","article-title":"When and why PINNs fail to train: A neural tangent kernel perspective","volume":"449","author":"Wang","year":"2022","journal-title":"J. Comput. Phys."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"A3055","DOI":"10.1137\/20M1318043","article-title":"Understanding and mitigating gradient flow pathologies in physics-informed neural networks","volume":"43","author":"Wang","year":"2021","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Redko, I., Morvant, E., Habrard, A., Sebban, M., and Bennani, Y. (2019). Advances in Domain Adaptation Theory, Elsevier.","DOI":"10.1016\/B978-1-78548-236-6.50002-7"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/8\/1096\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:06:16Z","timestamp":1760141176000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/8\/1096"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,9]]},"references-count":84,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["e24081096"],"URL":"https:\/\/doi.org\/10.3390\/e24081096","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,8,9]]}}}