{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T12:22:55Z","timestamp":1775737375132,"version":"3.50.1"},"reference-count":109,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T00:00:00Z","timestamp":1747699200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/"}],"funder":[{"name":"FCT - Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","award":["UIDB\/00326\/2025 and UIDP\/00326\/2025"],"award-info":[{"award-number":["UIDB\/00326\/2025 and UIDP\/00326\/2025"]}]},{"name":"Portuguese Foundation for Science and Technology (FCT) Research","award":["2020.05488.BD"],"award-info":[{"award-number":["2020.05488.BD"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Healthcare"],"published-print":{"date-parts":[[2025,7,31]]},"abstract":"<jats:p>Image inpainting is a crucial technique in computer vision, particularly for reconstructing corrupted images. In medical imaging, it addresses issues from instrumental errors, artifacts, or human factors. The development of deep learning techniques has revolutionized image inpainting, allowing for the generation of high-level semantic information to ensure structural and textural consistency in restored images. This article presents a comprehensive review of 53 studies on deep image inpainting in medical imaging, analyzing its evolution, impact, and limitations. The findings highlight the significance of deep image inpainting in artifact removal and enhancing the performance of multi-task approaches by localizing and inpainting regions of interest. Furthermore, the study identifies magnetic resonance imaging and computed tomography as the predominant modalities and highlights generative adversarial networks and U-Net as preferred architectures. Future research directions include the development of blind inpainting techniques, the exploration of techniques suitable for 3D\/4D images, multiple artifacts, and multi-task applications, and the improvement of architectures.<\/jats:p>","DOI":"10.1145\/3712710","type":"journal-article","created":{"date-parts":[[2025,1,23]],"date-time":"2025-01-23T17:59:31Z","timestamp":1737655171000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["The Role of Deep Learning in Medical Image Inpainting: A Systematic Review"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7885-9697","authenticated-orcid":false,"given":"Joana Cristo","family":"Santos","sequence":"first","affiliation":[{"name":"Department of Informatics Engineering, University of Coimbra, CISUC\/LASI\u2014Centre for Informatics and Systems of the University of Coimbra, Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4579-3713","authenticated-orcid":false,"given":"Hugo","family":"Tom\u00e1s Pereira Alexandre","sequence":"additional","affiliation":[{"name":"Department of Informatics Engineering, University of Coimbra, CISUC\/LASI\u2014Centre for Informatics and Systems of the University of Coimbra, Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5912-963X","authenticated-orcid":false,"given":"Miriam","family":"Seoane Santos","sequence":"additional","affiliation":[{"name":"Laboratory of Artificial Intelligence and Decision Support (LIAAD\u2014INESC TEC), Porto, Portugal and Department of Computer Sciences, University of Porto (FCUP), Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9278-8194","authenticated-orcid":false,"given":"Pedro","family":"Henriques Abreu","sequence":"additional","affiliation":[{"name":"Department of Informatics Engineering, University of Coimbra, CISUC\/LASI\u2014Centre for Informatics and Systems of the University of Coimbra, Coimbra, Portugal"}]}],"member":"320","published-online":{"date-parts":[[2025,5,20]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI48211.2021.9434163"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compmedimag.2019.101684"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP40778.2020.9191207"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682677"},{"key":"e_1_3_1_6_2","unstructured":"Mehdi Astaraki Francesca De Benetti Yousef Yeganeh Iuliana Toma-Dasu \u00d6rjan Smedby Chunliang Wang Nassir Navab and Thomas Wendler. 2023. AutoPaint: A self-inpainting method for unsupervised anomaly detection. arXiv:2305.12358. Retrieved from https:\/\/arxiv.org\/abs\/2305.12358"},{"key":"e_1_3_1_7_2","first-page":"17981","volume-title":"Advances in Neural Information Processing Systems","author":"Austin Jacob","year":"2021","unstructured":"Jacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow, and Rianne Van Den Berg. 2021. Structured denoising diffusion models in discrete state-spaces. In Advances in Neural Information Processing Systems, 17981\u201317993."},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59354-4_9"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344972"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1515\/jisys-2013-0031"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-015-1190-z"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2023.05.006"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2023.3309249"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.3390\/bioengineering10020184"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2022.3167808"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2019.2901750"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475426"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.3390\/bioengineering10020207"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2021.106421"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01107"},{"key":"e_1_3_1_21_2","first-page":"21","volume-title":"International Conference on Learning Representations","author":"Dosovitskiy Alexey","year":"2020","unstructured":"Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. In International Conference on Learning Representations, 21."},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.84"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3301873"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11063-019-10163-0"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1002\/rcs.2228"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00958"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSSSM.2007.4280177"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12967-021-02992-2"},{"key":"e_1_3_1_29_2","volume-title":"Advances in Neural Information Processing Systems","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in Neural Information Processing Systems, Vol. 27. Curran Associates, Inc, Montreal, Quebec, Canada."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-33843-5_12"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2019.2912935"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2015.00456"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCC57789.2023.10165271"},{"key":"e_1_3_1_34_2","first-page":"6840","volume-title":"Advances in Neural Information Processing Systems","volume":"33","author":"Ho Jonathan","year":"2020","unstructured":"Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. In Advances in Neural Information Processing Systems, Vol. 33, 6840\u20136851."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073659"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2020.103147"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/MedAI59581.2023.00061"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-80930-w"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIPTM54933.2022.9754090"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59710-8_49"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13014-023-02384-4"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2020.00164"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2022.3194722"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2017.2730822"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01049"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ultrasmedbio.2023.12.011"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/BIBM47256.2019.8983136"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01252-6_6"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00925"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72084-1_8"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2023.109861"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01117"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.15837\/ijccc.2023.2.5088"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1002\/mp.16851"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI45749.2020.9098681"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59520-3_5"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1002\/mp.15039"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROBIO49542.2019.8961840"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2021.3112117"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00408"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI48211.2021.9434115"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2020.2991043"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.278"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1002\/mp.14295"},{"key":"e_1_3_1_65_2","first-page":"475","volume-title":"European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning","author":"Pereira Ricardo Cardoso","year":"2020","unstructured":"Ricardo Cardoso Pereira, Joana Cristo Santos, Jos\u00e9 Pereira Amorim, Pedro Pereira Rodrigues, and Pedro Henriques Abreu. 2020. Missing image data imputation using variational autoencoders with weighted loss.. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges, Belgium, 475\u2013480."},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN48605.2020.9206625"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10470-6_97"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3218444"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.displa.2021.102028"},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2016.2636665"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_3_1_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2372479"},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA54385.2022.10032420"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-58547-0_15"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1088\/2516-1091\/ad776b"},{"key":"e_1_3_1_77_2","first-page":"727","volume-title":"European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning","author":"Santos Joana Cristo","year":"2024","unstructured":"Joana Cristo Santos, Miriam Seoane Santos, and Pedro Henriques Abreu. 2024. Reconstruction of mammography projections using image-to-image translation techniques. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges, Belgium, 727\u2013732."},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102708"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3599957.3606226"},{"key":"e_1_3_1_80_2","unstructured":"Ecem Sogancioglu Shi Hu Davide Belli and Bram van Ginneken. 2018. Chest X-ray inpainting with deep generative models. arXiv:1809.01471. Retrieved from https:\/\/arxiv.org\/abs\/1809.01471"},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3426020.3426088"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.3390\/app11094247"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-0716-3195-9_3"},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","unstructured":"Qianna Wang Yi Chen Nan Zhang and Yanhui Gu. 2021. Medical image inpainting with edge and structure priors. Measurement 185 (2021) 110027. DOI: 10.1016\/j.measurement.2021.110027","DOI":"10.1016\/j.measurement.2021.110027"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2023.3312292"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32254-0_57"},{"key":"e_1_3_1_87_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2023.3318127"},{"key":"e_1_3_1_88_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2020.101812"},{"key":"e_1_3_1_89_2","first-page":"1","volume-title":"Advances in Neural Information Processing Systems","author":"Xie Junyuan","year":"2012","unstructured":"Junyuan Xie, Linli Xu, and Enhong Chen. 2012. Image denoising and inpainting with deep neural networks. In Advances in Neural Information Processing Systems, Vol. 25. Curran Associates, Inc., Lake Tahoe Nevada, 1\u20139."},{"key":"e_1_3_1_90_2","doi-asserted-by":"publisher","DOI":"10.1002\/mp.15931"},{"key":"e_1_3_1_91_2","doi-asserted-by":"publisher","DOI":"10.1002\/mp.16724"},{"key":"e_1_3_1_92_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2022.3149754"},{"key":"e_1_3_1_93_2","first-page":"1790","volume-title":"Advances in Neural Information Processing Systems","author":"Xu Li","year":"2014","unstructured":"Li Xu, Jimmy S. J. Ren, Ce Liu, and Jiaya Jia. 2014. Deep convolutional neural network for image deconvolution. In Advances in Neural Information Processing Systems, Vol. 27. MIT Press, Cambridge, MA, 1790\u2013179."},{"key":"e_1_3_1_94_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI.2018.8363617"},{"key":"e_1_3_1_95_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.434"},{"key":"e_1_3_1_96_2","doi-asserted-by":"publisher","unstructured":"Jing Yang and Nur Intan Raihana Ruhaiyem. 2024. Review of deep learning-based image inpainting techniques. IEEE Access 12 (2024) 138441\u2013138482. DOI: 10.1109\/ACCESS.2024.3461782","DOI":"10.1109\/ACCESS.2024.3461782"},{"key":"e_1_3_1_97_2","doi-asserted-by":"publisher","DOI":"10.3389\/fbioe.2020.00599"},{"key":"e_1_3_1_98_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.728"},{"key":"e_1_3_1_99_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00577"},{"key":"e_1_3_1_100_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00457"},{"key":"e_1_3_1_101_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISPDS58840.2023.10235664"},{"key":"e_1_3_1_102_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/4265650"},{"key":"e_1_3_1_103_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59861-7_13"},{"key":"e_1_3_1_104_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2020.3023144"},{"key":"e_1_3_1_105_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2021.3101551"},{"key":"e_1_3_1_106_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2022.08.033"},{"key":"e_1_3_1_107_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compmedimag.2021.101862"},{"key":"e_1_3_1_108_2","first-page":"1","volume-title":"International Conference on Learning Representations","author":"Zhao Shengyu","year":"2021","unstructured":"Shengyu Zhao, Jonathan Cui, Yilun Sheng, Yue Dong, Xiao Liang, I. Eric, Chao Chang, and Yan Xu. 2021. Large scale image completion via co-modulated generative adversarial networks. In International Conference on Learning Representations, 1\u201325."},{"key":"e_1_3_1_109_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-19787-1_16"},{"key":"e_1_3_1_110_2","unstructured":"Ruizhi Zhu Xinru Zhang Haowen Pang Chundan Xu and Chuyang Ye. 2024. Advancing brain tumor inpainting with generative models. arXiv:2402.01509. Retrieved from https:\/\/arxiv.org\/abs\/2402.01509"}],"container-title":["ACM Transactions on Computing for Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3712710","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3712710","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:09Z","timestamp":1750295889000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3712710"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,20]]},"references-count":109,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,7,31]]}},"alternative-id":["10.1145\/3712710"],"URL":"https:\/\/doi.org\/10.1145\/3712710","relation":{},"ISSN":["2637-8051"],"issn-type":[{"value":"2637-8051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,20]]},"assertion":[{"value":"2024-06-28","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}