{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,26]],"date-time":"2025-09-26T16:47:53Z","timestamp":1758905273497},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T00:00:00Z","timestamp":1698710400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T00:00:00Z","timestamp":1698710400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100017590","name":"Universit\u00e4tsklinikum Essen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100017590","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Imaging"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>With the rise in importance of personalized medicine and deep learning, we combine the two to create personalized neural networks. The aim of the study is to show a proof of concept that data from just one patient can be used to train deep neural networks to detect tumor progression in longitudinal datasets.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Two datasets with 64 scans from 32 patients with glioblastoma multiforme (GBM) were evaluated in this study. The contrast-enhanced T1w sequences of brain magnetic resonance imaging (MRI) images were used. We trained a neural network for each patient using just two scans from different timepoints to map the difference between the images. The change in tumor volume can be calculated with this map. The neural networks were a form of a Wasserstein-GAN (generative adversarial network), an unsupervised learning architecture. The combination of data augmentation and the network architecture allowed us to skip the co-registration of the images. Furthermore, no additional training data, pre-training of the networks or any (manual) annotations are necessary.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The model achieved an AUC-score of 0.87 for tumor change. We also introduced a modified RANO criteria, for which an accuracy of 66% can be achieved.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>We show a novel approach to deep learning in using data from just one patient to train deep neural networks to monitor tumor change. Using two different datasets to evaluate the results shows the potential to generalize the method.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12880-023-01128-w","type":"journal-article","created":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T17:01:51Z","timestamp":1698771711000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["\u201cA net for everyone\u201d: fully personalized and unsupervised neural networks trained with longitudinal data from a single patient"],"prefix":"10.1186","volume":"23","author":[{"given":"Christian","family":"Strack","sequence":"first","affiliation":[]},{"given":"Kelsey L.","family":"Pomykala","sequence":"additional","affiliation":[]},{"given":"Heinz-Peter","family":"Schlemmer","sequence":"additional","affiliation":[]},{"given":"Jan","family":"Egger","sequence":"additional","affiliation":[]},{"given":"Jens","family":"Kleesiek","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,31]]},"reference":[{"key":"1128_CR1","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L. ImageNet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition. 2009. p.\u00a0248\u201355.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"1128_CR2","doi-asserted-by":"crossref","unstructured":"Fredrikson M, Jha S, Ristenpart T. Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures. In: Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security. Denver Colorado USA: ACM; 2015. p.\u00a01322\u201333.","DOI":"10.1145\/2810103.2813677"},{"key":"1128_CR3","unstructured":"Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D. Matching Networks for One Shot Learning. 2017."},{"key":"1128_CR4","doi-asserted-by":"crossref","unstructured":"Taigman Y, Yang M, Ranzato M, Wolf L, DeepFace. Closing the Gap to Human-Level Performance in Face Verification. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA: IEEE; 2014. p.\u00a01701\u20138.","DOI":"10.1109\/CVPR.2014.220"},{"key":"1128_CR5","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1007\/978-3-030-61609-0_34","volume-title":"Artificial neural networks and machine learning \u2013 ICANN 2020","author":"PS Zarrin","year":"2020","unstructured":"Zarrin PS, Wenger C. Implementation of siamese-based few-shot learning algorithms for the distinction of COPD and Asthma subjects. In: Farka\u0161 I, Masulli P, Wermter S, editors. Artificial neural networks and machine learning \u2013 ICANN 2020. Cham: Springer International Publishing; 2020. pp. 431\u201340."},{"key":"1128_CR6","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/978-3-658-36295-9_5","volume-title":"Data Science \u2013 Analytics and Applications","author":"ME Tschuchnig","year":"2022","unstructured":"Tschuchnig ME, Gadermayr M. Anomaly Detection in Medical Imaging - A Mini Review. In: Haber P, Lampoltshammer TJ, Leopold H, Mayr M, editors. Data Science \u2013 Analytics and Applications. Wiesbaden: Springer Fachmedien; 2022. pp. 33\u20138."},{"key":"1128_CR7","unstructured":"Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S et al. Generative Adversarial Networks. ArXiv14062661 Cs Stat. 2014."},{"key":"1128_CR8","doi-asserted-by":"crossref","unstructured":"Kwon G, Han C, Kim D. Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networks. 2019.","DOI":"10.1007\/978-3-030-32248-9_14"},{"key":"1128_CR9","doi-asserted-by":"crossref","unstructured":"Chuquicusma MJM, Hussein S, Burt J, Bagci U. How to fool radiologists with generative adversarial networks? A visual turing test for Lung Cancer diagnosis. 2018.","DOI":"10.1109\/ISBI.2018.8363564"},{"key":"1128_CR10","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1016\/j.media.2019.06.014","volume":"57","author":"M Rubin","year":"2019","unstructured":"Rubin M, Stein O, Turko NA, Nygate Y, Roitshtain D, Karako L, et al. TOP-GAN: stain-free cancer cell classification using deep learning with a small training set. Med Image Anal. 2019;57:176\u201385.","journal-title":"Med Image Anal"},{"key":"1128_CR11","doi-asserted-by":"publisher","first-page":"101716","DOI":"10.1016\/j.media.2020.101716","volume":"64","author":"B Lei","year":"2020","unstructured":"Lei B, Xia Z, Jiang F, Jiang X, Ge Z, Xu Y, et al. Skin lesion segmentation via generative adversarial networks with dual discriminators. Med Image Anal. 2020;64:101716.","journal-title":"Med Image Anal"},{"key":"1128_CR12","doi-asserted-by":"publisher","first-page":"6242","DOI":"10.1073\/pnas.97.12.6242","volume":"97","author":"EC Holland","year":"2000","unstructured":"Holland EC. Glioblastoma Multiforme: the terminator. Proc Natl Acad Sci U S A. 2000;97:6242\u20134.","journal-title":"Proc Natl Acad Sci U S A"},{"key":"1128_CR13","doi-asserted-by":"publisher","first-page":"1134","DOI":"10.1016\/S0140-6736(16)31891-8","volume":"389","author":"N Harbeck","year":"2017","unstructured":"Harbeck N, Gnant M. Breast cancer. Lancet Lond Engl. 2017;389:1134\u201350.","journal-title":"Lancet Lond Engl"},{"key":"1128_CR14","doi-asserted-by":"publisher","first-page":"2532","DOI":"10.1001\/jama.2017.7248","volume":"317","author":"MS Litwin","year":"2017","unstructured":"Litwin MS, Tan H-J. The diagnosis and treatment of Prostate Cancer: a review. JAMA. 2017;317:2532\u201342.","journal-title":"JAMA"},{"key":"1128_CR15","doi-asserted-by":"publisher","first-page":"1061","DOI":"10.1517\/13543780903052764","volume":"18","author":"C Adamson","year":"2009","unstructured":"Adamson C, Kanu OO, Mehta AI, Di C, Lin N, Mattox AK, et al. Glioblastoma Multiforme: a review of where we have been and where we are going. Expert Opin Investig Drugs. 2009;18:1061\u201383.","journal-title":"Expert Opin Investig Drugs"},{"key":"1128_CR16","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1038\/srep01364","volume":"3","author":"J Egger","year":"2013","unstructured":"Egger J, Kapur T, Fedorov A, Pieper S, Miller JV, Veeraraghavan H, et al. GBM Volumetry using the 3D Slicer Medical Image Computing platform. Sci Rep. 2013;3:1364.","journal-title":"Sci Rep"},{"key":"1128_CR17","doi-asserted-by":"publisher","first-page":"e773","DOI":"10.7717\/peerj-cs.773","volume":"7","author":"J Egger","year":"2021","unstructured":"Egger J, Pepe A, Gsaxner C, Jin Y, Li J, Kern R. Deep learning\u2014a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact. PeerJ Comput Sci. 2021;7:e773.","journal-title":"PeerJ Comput Sci"},{"key":"1128_CR18","doi-asserted-by":"publisher","first-page":"20TR01","DOI":"10.1088\/1361-6560\/ab843e","volume":"65","author":"Y Fu","year":"2020","unstructured":"Fu Y, Lei Y, Wang T, Curran WJ, Liu T, Yang X. Deep learning in medical image registration: a review. Phys Med Biol. 2020;65:20TR01.","journal-title":"Phys Med Biol"},{"key":"1128_CR19","unstructured":"Arjovsky M, Chintala S, Bottou L, Wasserstein GAN. ArXiv170107875 Cs Stat. 2017."},{"key":"1128_CR20","doi-asserted-by":"crossref","unstructured":"Baumgartner CF, Koch LM, Tezcan KC, Ang JX, Konukoglu E. Visual Feature Attribution using Wasserstein GANs. ArXiv171108998 Cs. 2018.","DOI":"10.1109\/CVPR.2018.00867"},{"key":"1128_CR21","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. ArXiv150504597 Cs. 2015.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"1128_CR22","doi-asserted-by":"crossref","unstructured":"Tran D, Bourdev L, Fergus R, Torresani L, Paluri M. Learning Spatiotemporal Features with 3D Convolutional Networks. In: 2015 IEEE International Conference on Computer Vision (ICCV). 2015. p.\u00a04489\u201397.","DOI":"10.1109\/ICCV.2015.510"},{"key":"1128_CR23","unstructured":"Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville A. Improved Training of Wasserstein GANs. ArXiv170400028 Cs Stat. 2017."},{"key":"1128_CR24","unstructured":"Kingma DP, Ba J. Adam: A Method for Stochastic Optimization. 2017."},{"key":"1128_CR25","doi-asserted-by":"publisher","first-page":"1323","DOI":"10.1016\/j.mri.2012.05.001","volume":"30","author":"A Fedorov","year":"2012","unstructured":"Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin J-C, Pujol S, et al. 3D slicer as an image Computing platform for the Quantitative Imaging Network. Magn Reson Imaging. 2012;30:1323\u201341.","journal-title":"Magn Reson Imaging"},{"key":"1128_CR26","doi-asserted-by":"publisher","first-page":"4952","DOI":"10.1002\/hbm.24750","volume":"40","author":"F Isensee","year":"2019","unstructured":"Isensee F, Schell M, Pflueger I, Brugnara G, Bonekamp D, Neuberger U, et al. Automated brain extraction of multisequence MRI using artificial neural networks. Hum Brain Mapp. 2019;40:4952\u201364.","journal-title":"Hum Brain Mapp"},{"key":"1128_CR27","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.procs.2018.10.513","volume":"144","author":"FU Nuha","year":"2018","unstructured":"Nuha FU. Afiahayati. Training dataset reduction on generative adversarial network. Procedia Comput Sci. 2018;144:133\u20139.","journal-title":"Procedia Comput Sci"},{"key":"1128_CR28","unstructured":"Ferreira A, Li J, Pomykala KL, Kleesiek J, Alves V, Egger J. GAN-based generation of realistic 3D data: A systematic review and taxonomy. 2022."},{"key":"1128_CR29","unstructured":"Isensee F, J\u00e4ger P, Wasserthal J, Zimmerer D, Petersen J, Kohl S et al. batchgenerators - a python framework for data augmentation. 2020."},{"key":"1128_CR30","doi-asserted-by":"publisher","first-page":"25007","DOI":"10.1038\/srep25007","volume":"6","author":"J Kleesiek","year":"2016","unstructured":"Kleesiek J, Petersen J, D\u00f6ring M, Maier-Hein K, K\u00f6the U, Wick W, et al. Virtual raters for reproducible and objective assessments in Radiology. Sci Rep. 2016;6:25007.","journal-title":"Sci Rep"},{"key":"1128_CR31","doi-asserted-by":"publisher","first-page":"1045","DOI":"10.1007\/s10278-013-9622-7","volume":"26","author":"K Clark","year":"2013","unstructured":"Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, et al. The Cancer Imaging Archive (TCIA): maintaining and operating a Public Information Repository. J Digit Imaging. 2013;26:1045\u201357.","journal-title":"J Digit Imaging"},{"key":"1128_CR32","unstructured":"Schmainda K, Prah M. Data from Brain-Tumor-Progression. 2019."},{"key":"1128_CR33","doi-asserted-by":"crossref","unstructured":"Isensee F, Jaeger PF, Full PM, Vollmuth P, Maier-Hein KH. nnU-Net for Brain Tumor Segmentation. arXiv; 2020.","DOI":"10.1007\/978-3-030-72087-2_11"},{"key":"1128_CR34","doi-asserted-by":"publisher","first-page":"1963","DOI":"10.1200\/JCO.2009.26.3541","volume":"28","author":"PY Wen","year":"2010","unstructured":"Wen PY, Macdonald DR, Reardon DA, Cloughesy TF, Sorensen AG, Galanis E, et al. Updated response Assessment Criteria for High-Grade gliomas: Response Assessment in Neuro-Oncology Working Group. J Clin Oncol. 2010;28:1963\u201372.","journal-title":"J Clin Oncol"},{"key":"1128_CR35","unstructured":"Hestness J, Narang S, Ardalani N, Diamos G, Jun H, Kianinejad H et al. Deep Learning Scaling is Predictable, Empirically. 2017."},{"key":"1128_CR36","unstructured":"Erdt M, Steger S, Sakas G, Regmentation. A New View of Image Segmentation and Registration. 2012;:23."},{"key":"1128_CR37","first-page":"18","volume":"2","author":"MV Wyawahare","year":"2009","unstructured":"Wyawahare MV, Patil DPM, Abhyankar HK. Image Registration techniques: an overview. Image Process Pattern Recognit. 2009;2:18.","journal-title":"Image Process Pattern Recognit"},{"key":"1128_CR38","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1109\/LSP.2009.2033728","volume":"17","author":"B Qin","year":"2010","unstructured":"Qin B, Gu Z, Sun X, Lv Y. Registration of images with outliers using Joint Saliency Map. IEEE Signal Process Lett. 2010;17:91\u20134.","journal-title":"IEEE Signal Process Lett"},{"key":"1128_CR39","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1148\/radiographics.16.6.8946545","volume":"16","author":"JH Rees","year":"1996","unstructured":"Rees JH, Smirniotopoulos JG, Jones RV, Wong K. Glioblastoma Multiforme: radiologic-pathologic correlation. Radiographics. 1996;16:1413\u201338.","journal-title":"Radiographics"},{"key":"1128_CR40","doi-asserted-by":"publisher","first-page":"1993","DOI":"10.1109\/TMI.2014.2377694","volume":"34","author":"BH Menze","year":"2015","unstructured":"Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, et al. The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS). IEEE Trans Med Imaging. 2015;34:1993\u20132024.","journal-title":"IEEE Trans Med Imaging"},{"key":"1128_CR41","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1007\/s00701-019-04110-0","volume":"162","author":"EM Berntsen","year":"2020","unstructured":"Berntsen EM, Stensj\u00f8en AL, Langlo MS, Simonsen SQ, Christensen P, Moholdt VA, et al. Volumetric segmentation of glioblastoma progression compared to bidimensional products and clinical radiological reports. Acta Neurochir (Wien). 2020;162:379\u201387.","journal-title":"Acta Neurochir (Wien)"},{"key":"1128_CR42","first-page":"770","volume":"26","author":"MF Dempsey","year":"2005","unstructured":"Dempsey MF, Condon BR, Hadley DM. Measurement of Tumor size in recurrent malignant glioma: 1D, 2D, or 3D? AJNR. Am J Neuroradiol. 2005;26:770\u20136.","journal-title":"Am J Neuroradiol"},{"key":"1128_CR43","doi-asserted-by":"publisher","first-page":"e0164891","DOI":"10.1371\/journal.pone.0164891","volume":"11","author":"EH Fyllingen","year":"2016","unstructured":"Fyllingen EH, Stensj\u00f8en AL, Berntsen EM, Solheim O, Reinertsen I. Glioblastoma segmentation: comparison of three different Software packages. PLoS ONE. 2016;11:e0164891.","journal-title":"PLoS ONE"},{"key":"1128_CR44","doi-asserted-by":"publisher","first-page":"634","DOI":"10.1038\/ncponc1204","volume":"5","author":"AG Sorensen","year":"2008","unstructured":"Sorensen AG, Batchelor TT, Wen PY, Zhang W-T, Jain RK. Response criteria for glioma. Nat Clin Pract Oncol. 2008;5:634\u201344.","journal-title":"Nat Clin Pract Oncol"},{"key":"1128_CR45","doi-asserted-by":"publisher","first-page":"101773","DOI":"10.1016\/j.media.2020.101773","volume":"65","author":"A Pepe","year":"2020","unstructured":"Pepe A, Li J, Rolf-Pissarczyk M, Gsaxner C, Chen X, Holzapfel GA, et al. Detection, segmentation, simulation and visualization of aortic dissections: a review. Med Image Anal. 2020;65:101773.","journal-title":"Med Image Anal"}],"container-title":["BMC Medical Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-023-01128-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12880-023-01128-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-023-01128-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T17:02:44Z","timestamp":1698771764000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedimaging.biomedcentral.com\/articles\/10.1186\/s12880-023-01128-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,31]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1128"],"URL":"https:\/\/doi.org\/10.1186\/s12880-023-01128-w","relation":{},"ISSN":["1471-2342"],"issn-type":[{"value":"1471-2342","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,31]]},"assertion":[{"value":"9 November 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Retrospective usage of data in this feasibility study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the ethics committee of the medical faculty of the university of Duisburg-Essen (21-10060-BO from 18.5.2021). The need for informed consent was waived by the ethics committee of the medical faculty of the university of Duisburg-Essen (21-10060-BO from 18.5.2021) due to the retrospective nature of the study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"174"}}