{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T04:27:09Z","timestamp":1772252829017,"version":"3.50.1"},"reference-count":69,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,10,31]],"date-time":"2021-10-31T00:00:00Z","timestamp":1635638400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>This work aims at developing a generalizable Magnetic Resonance Imaging (MRI) reconstruction method in the meta-learning framework. Specifically, we develop a deep reconstruction network induced by a learnable optimization algorithm (LOA) to solve the nonconvex nonsmooth variational model of MRI image reconstruction. In this model, the nonconvex nonsmooth regularization term is parameterized as a structured deep network where the network parameters can be learned from data. We partition these network parameters into two parts: a task-invariant part for the common feature encoder component of the regularization, and a task-specific part to account for the variations in the heterogeneous training and testing data. We train the regularization parameters in a bilevel optimization framework which significantly improves the robustness of the training process and the generalization ability of the network. We conduct a series of numerical experiments using heterogeneous MRI data sets with various undersampling patterns, ratios, and acquisition settings. The experimental results show that our network yields greatly improved reconstruction quality over existing methods and can generalize well to new reconstruction problems whose undersampling patterns\/trajectories are not present during training.<\/jats:p>","DOI":"10.3390\/jimaging7110231","type":"journal-article","created":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T22:21:34Z","timestamp":1635805294000},"page":"231","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Dataset"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3178-9708","authenticated-orcid":false,"given":"Wanyu","family":"Bian","sequence":"first","affiliation":[{"name":"Department of Mathematics, University of Florida, Gainesville, FL 32611, USA"}]},{"given":"Yunmei","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of Florida, Gainesville, FL 32611, USA"}]},{"given":"Xiaojing","family":"Ye","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, Georgia State University, Atlanta, GA 30303, USA"}]},{"given":"Qingchao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of Florida, Gainesville, FL 32611, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Li, D., Yang, Y., Song, Y.Z., and Hospedales, T.M. (2018, January 2\u20137). Learning to generalize: Meta-learning for domain generalization. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11596"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Qui\u00f1onero-Candela, J., Sugiyama, M., Lawrence, N.D., and Schwaighofer, A. (2009). Dataset Shift in Machine Learning, Mit Press.","DOI":"10.7551\/mitpress\/9780262170055.001.0001"},{"key":"ref_3","first-page":"137","article-title":"Analysis of representations for domain adaptation","volume":"19","author":"Blitzer","year":"2007","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_4","first-page":"998","article-title":"Metareg: Towards domain generalization using meta-regularization","volume":"31","author":"Balaji","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1093\/nsr\/nwt032","article-title":"Challenges of big data analysis","volume":"1","author":"Fan","year":"2014","journal-title":"Natl. Sci. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-017-0089-0","article-title":"A survey on heterogeneous transfer learning","volume":"4","author":"Day","year":"2017","journal-title":"J. Big Data"},{"key":"ref_7","unstructured":"Munkhdalai, T., and Yu, H. (2017, January 6\u201311). Meta networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_8","unstructured":"Finn, C., Abbeel, P., and Levine, S. (2017, January 6\u201311). Model-agnostic meta-learning for fast adaptation of deep networks. Proceedings of the International Conference on Machine Learning, Sydney, NSW, Australia."},{"key":"ref_9","unstructured":"Rusu, A.A., Rao, D., Sygnowski, J., Vinyals, O., Pascanu, R., Osindero, S., and Hadsell, R. (May, January 30). Meta-Learning with Latent Embedding Optimization. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_10","unstructured":"Yao, H., Huang, L.K., Zhang, L., Wei, Y., Tian, L., Zou, J., and Huang, J. (2021, January 18\u201324). Improving generalization in meta-learning via task augmentation. In Proceedings of the International Conference on Machine Learning, Virtual Event."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Thrun, S., and Pratt, L. (1998). Learning to learn: Introduction and overview. Learning to Learn, Springer.","DOI":"10.1007\/978-1-4615-5529-2"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hospedales, T.M., Antoniou, A., Micaelli, P., and Storkey, A.J. (2020). Meta-Learning in Neural Networks: A Survey. arXiv.","DOI":"10.1109\/TPAMI.2021.3079209"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1137\/20M1353368","article-title":"Learnable Descent Algorithm for Nonsmooth Nonconvex Image Reconstruction","volume":"14","author":"Chen","year":"2021","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_14","unstructured":"Yao, H., Wu, X., Tao, Z., Li, Y., Ding, B., Li, R., and Li, Z. (2020). Automated relational meta-learning. arXiv."},{"key":"ref_15","unstructured":"Lee, Y., and Choi, S. (2018, January 10\u201315). Gradient-based meta-learning with learned layerwise metric and subspace. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4483","DOI":"10.1007\/s10462-021-10004-4","article-title":"A survey of deep meta-learning","volume":"54","author":"Huisman","year":"2021","journal-title":"Artif. Intell. Rev."},{"key":"ref_17","unstructured":"Koch, G., Zemel, R., and Salakhutdinov, R. (July, January 6\u2013). Siamese neural networks for one-shot image recognition. Proceedings of the ICML Deep Learning Workshop, Lille, France."},{"key":"ref_18","first-page":"3630","article-title":"Matching networks for one shot learning","volume":"29","author":"Vinyals","year":"2016","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_19","unstructured":"Snell, J., Swersky, K., and Zemel, R.S. (2017). Prototypical networks for few-shot learning. arXiv."},{"key":"ref_20","unstructured":"Mishra, N., Rohaninejad, M., Chen, X., and Abbeel, P. (2017). A simple neural attentive meta-learner. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ravi, S., and Larochelle, H. (2021, October 29). Optimization as a Model for Few-Shot Learning. Available online: https:\/\/openreview.net\/forum?id=rJY0-Kcll.","DOI":"10.1007\/978-3-030-63416-2_861"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Qiao, S., Liu, C., Shen, W., and Yuille, A.L. (2018, January 18\u201323). Few-shot image recognition by predicting parameters from activations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00755"},{"key":"ref_23","unstructured":"Graves, A., Wayne, G., and Danihelka, I. (2014). Neural turing machines. arXiv."},{"key":"ref_24","unstructured":"Rajeswaran, A., Finn, C., Kakade, S., and Levine, S. (2021, October 29). Meta-Learning with Implicit Gradients. Available online: https:\/\/papers.nips.cc\/paper\/2019\/hash\/072b030ba126b2f4b2374f342be9ed44-Abstract.html."},{"key":"ref_25","unstructured":"Li, Z., Zhou, F., Chen, F., and Li, H. (2017). Meta-sgd: Learning to learn quickly for few-shot learning. arXiv."},{"key":"ref_26","unstructured":"Antoniou, A., Edwards, H., and Storkey, A. (2018). How to train your MAML. arXiv."},{"key":"ref_27","unstructured":"Nichol, A., Achiam, J., and Schulman, J. (2018). On first-order meta-learning algorithms. arXiv."},{"key":"ref_28","unstructured":"Finn, C., Rajeswaran, A., Kakade, S., and Levine, S. (2019, January 9\u201315). Online meta-learning. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_29","unstructured":"Grant, E., Finn, C., Levine, S., Darrell, T., and Griffiths, T. (2018). Recasting gradient-based meta-learning as hierarchical bayes. arXiv."},{"key":"ref_30","unstructured":"Finn, C., Xu, K., and Levine, S. (2018). Probabilistic model-agnostic meta-learning. arXiv."},{"key":"ref_31","unstructured":"Yoon, J., Kim, T., Dia, O., Kim, S., Bengio, Y., and Ahn, S. (2018, January 3\u20138). Bayesian model-agnostic meta-learning. Proceedings of the 32nd International Conference on Neural Information Processing Systems, Montr\u00e9al, QC, Canada."},{"key":"ref_32","unstructured":"Vuorio, R., Sun, S.H., Hu, H., and Lim, J.J. (2019). Multimodal model-agnostic meta-learning via task-aware modulation. arXiv."},{"key":"ref_33","unstructured":"Yao, H., Wei, Y., Huang, J., and Li, Z. (2021, January 18\u201324). Hierarchically structured meta-learning. Proceedings of the International Conference on Machine Learning, Virtual."},{"key":"ref_34","unstructured":"Yin, M., Tucker, G., Zhou, M., Levine, S., and Finn, C. (2019). Meta-Learning without Memorization. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Jenni, S., and Favaro, P. (2018, January 8\u201314). Deep bilevel learning. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01249-6_38"},{"key":"ref_36","unstructured":"Chen, W.Y., Liu, Y.C., Kira, Z., Wang, Y.C., and Huang, J.B. (2019, January 6\u20139). A Closer Look at Few-shot Classification. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_37","unstructured":"Li, Y., Yang, Y., Zhou, W., and Hospedales, T. (2019, January 9\u201315). Feature-critic networks for heterogeneous domain generalization. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_38","unstructured":"Rebuffi, S.A., Bilen, H., and Vedaldi, A. (2017, January 4\u20139). Learning multiple visual domains with residual adapters. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_39","unstructured":"Triantafillou, E., Zhu, T., Dumoulin, V., Lamblin, P., Evci, U., Xu, K., Goroshin, R., Gelada, C., Swersky, K.J., and Manzagol, P.A. (2020, January 26\u201330). Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia."},{"key":"ref_40","unstructured":"Yu, T., Quillen, D., He, Z., Julian, R., Hausman, K., Finn, C., and Levine, S. (2020, January 16\u201318). Meta-world: A benchmark and evaluation for multi-task and meta reinforcement learning. Proceedings of the Conference on Robot Learning, Virtual."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1109\/TMI.2010.2085084","article-title":"Compressed-sensing MRI with random encoding","volume":"30","author":"Haldar","year":"2010","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1109\/83.661180","article-title":"Color TV: Total variation methods for restoration of vector-valued images","volume":"7","author":"Blomgren","year":"1998","journal-title":"IEEE Trans. Image Process."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.zemedi.2018.11.002","article-title":"An overview of deep learning in medical imaging focusing on MRI","volume":"29","author":"Lundervold","year":"2019","journal-title":"Z. F\u00fcr Med. Phys."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1109\/MSP.2019.2950557","article-title":"Deep magnetic resonance image reconstruction: Inverse problems meet neural networks","volume":"37","author":"Liang","year":"2020","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/MSP.2019.2950433","article-title":"Compressed sensing: From research to clinical practice with deep neural networks: Shortening scan times for magnetic resonance imaging","volume":"37","author":"Sandino","year":"2020","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/MSP.2017.2739299","article-title":"Convolutional neural networks for inverse problems in imaging: A review","volume":"34","author":"McCann","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_47","unstructured":"Zhou, S.K., Greenspan, H., Davatzikos, C., Duncan, J.S., van Ginneken, B., Madabhushi, A., Prince, J.L., Rueckert, D., and Summers, R.M. A Review of Deep Learning in Medical Imaging: Image Traits, Technology Trends, Case Studies with Progress Highlights, and Future Promises."},{"key":"ref_48","first-page":"293","article-title":"Deep Learning Applications in Medical Image Analysis","volume":"6","author":"Singha","year":"2021","journal-title":"Biomed. Data Min. Inf. Retr. Methodol. Tech. Appl."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1111\/1754-9485.13276","article-title":"Deep learning in magnetic resonance image reconstruction","volume":"5","author":"Chandra","year":"2021","journal-title":"J. Med Imaging Radiat. Oncol."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ahishakiye, E., Van Gijzen, M.B., Tumwiine, J., Wario, R., and Obungoloch, J. (2021). A survey on deep learning in medical image reconstruction. Intell. Med., Available online: https:\/\/www.sciencedirect.com\/science\/article\/pii\/S2667102621000061.","DOI":"10.1016\/j.imed.2021.03.003"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"3055","DOI":"10.1002\/mrm.26977","article-title":"Learning a variational network for reconstruction of accelerated MRI data","volume":"79","author":"Hammernik","year":"2018","journal-title":"Magn. Reson. Med."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1109\/TMI.2018.2865356","article-title":"MoDL: Model-Based Deep Learning Architecture for Inverse Problems","volume":"38","author":"Aggarwal","year":"2019","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_53","first-page":"10","article-title":"Deep ADMM-Net for compressive sensing MRI","volume":"29","author":"Sun","year":"2016","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Ghanem, B. (2018, January 23). ISTA-Net: Interpretable optimization-inspired deep network for image compressive sensing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00196"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1137\/0716071","article-title":"Splitting algorithms for the sum of two nonlinear operators","volume":"16","author":"Lions","year":"1979","journal-title":"SIAM J. Numer. Anal."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1137\/080716542","article-title":"A fast iterative shrinkage-thresholding algorithm for linear inverse problems","volume":"2","author":"Beck","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_58","unstructured":"Mehra, A., and Hamm, J. (2019). Penalty method for inversion-free deep bilevel optimization. arXiv."},{"key":"ref_59","unstructured":"Kingma, D.P., and Ba, J. (2015). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_60","unstructured":"Glorot, X., and Bengio, Y. (2021, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the International Conference on Artificial Intelligence and Statistics. Society for Artificial Intelligence and Statistics, Virtual Event."},{"key":"ref_61","first-page":"270","article-title":"Effect of windowing and zero-filled reconstruction of MRI data on spatial resolution and acquisition strategy","volume":"14","author":"Bernstein","year":"2001","journal-title":"J. Magn. Reson. Imaging Off. J. Int. Soc. Magn. Reson. Med."},{"key":"ref_62","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2021, October 29). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: tensorflow.org."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"1993","DOI":"10.1109\/TMI.2014.2377694","article-title":"The multimodal brain tumor image segmentation benchmark (BRATS)","volume":"34","author":"Menze","year":"2014","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_64","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 16), Savannah, GA, USA."},{"key":"ref_65","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Sardinia, Italy."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.mri.2020.02.002","article-title":"DeepcomplexMRI: Exploiting deep residual network for fast parallel MR imaging with complex convolution","volume":"68","author":"Wang","year":"2020","journal-title":"Magn. Reson. Imaging"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Hore, A., and Ziou, D. (2010, January 23\u201326). Image quality metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"2427","DOI":"10.1016\/0960-1686(93)90410-Z","article-title":"On the use of the normalized mean square error in evaluating dispersion model performance","volume":"27","author":"Poli","year":"1993","journal-title":"Atmos. Environ. Part A Gen. Top."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/11\/231\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:23:45Z","timestamp":1760167425000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/11\/231"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,31]]},"references-count":69,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["jimaging7110231"],"URL":"https:\/\/doi.org\/10.3390\/jimaging7110231","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints202109.0450.v1","asserted-by":"object"}]},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,31]]}}}