{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T16:43:40Z","timestamp":1764002620614,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,6]],"date-time":"2023-03-06T00:00:00Z","timestamp":1678060800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Graphs are versatile structures for the representation of many real-world data. Deep Learning on graphs is currently able to solve a wide range of problems with excellent results. However, both the generation of graphs and the handling of large graphs still remain open challenges. This work aims to introduce techniques for generating large graphs and test the approach on a complex problem such as the calculation of dose distribution in oncological radiotherapy applications. To this end, we introduced a pooling technique (ReNN-Pool) capable of sampling nodes that are spatially uniform without computational requirements in both model training and inference. By construction, the ReNN-Pool also allows the definition of a symmetric un-pooling operation to recover the original dimensionality of the graphs. We also present a Variational AutoEncoder (VAE) for generating graphs, based on the defined pooling and un-pooling operations, which employs convolutional graph layers in both encoding and decoding phases. The performance of the model was tested on both the realistic use case of a cylindrical graph dataset for a radiotherapy application and the standard benchmark dataset sprite. Compared to other graph pooling techniques, ReNN-Pool proved to improve both performance and computational requirements.<\/jats:p>","DOI":"10.3390\/a16030143","type":"journal-article","created":{"date-parts":[[2023,3,7]],"date-time":"2023-03-07T01:43:35Z","timestamp":1678153415000},"page":"143","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Nearest Neighbours Graph Variational AutoEncoder"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3922-2052","authenticated-orcid":false,"given":"Lorenzo","family":"Arsini","sequence":"first","affiliation":[{"name":"Department of Physics, Sapienza University of Rome, 00185 Rome, Italy"},{"name":"INFN Section of Rome, 00185 Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8729-3533","authenticated-orcid":false,"given":"Barbara","family":"Caccia","sequence":"additional","affiliation":[{"name":"Istituto Superiore di Sanit\u00e0, 00161 Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1903-4406","authenticated-orcid":false,"given":"Andrea","family":"Ciardiello","sequence":"additional","affiliation":[{"name":"INFN Section of Rome, 00185 Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9192-3537","authenticated-orcid":false,"given":"Stefano","family":"Giagu","sequence":"additional","affiliation":[{"name":"Department of Physics, Sapienza University of Rome, 00185 Rome, Italy"},{"name":"INFN Section of Rome, 00185 Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8849-0259","authenticated-orcid":false,"given":"Carlo","family":"Mancini Terracciano","sequence":"additional","affiliation":[{"name":"Department of Physics, Sapienza University of Rome, 00185 Rome, Italy"},{"name":"INFN Section of Rome, 00185 Rome, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,6]]},"reference":[{"key":"ref_1","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Networks. arXiv."},{"key":"ref_2","unstructured":"Kingma, D.P., and Welling, M. (2014). Auto-Encoding Variational Bayes. arXiv."},{"key":"ref_3","unstructured":"Rezende, D., and Mohamed, S. (2015, January 6\u201311). Variational Inference with Normalizing Flows. Proceedings of the Machine Learning Research (PMLR), Proceedings of the 32nd International Conference on Machine Learning, Lille, France."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"7327","DOI":"10.1109\/TPAMI.2021.3116668","article-title":"Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models","volume":"44","author":"Leach","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3389","DOI":"10.1002\/mp.15555","article-title":"Fast and accurate dose predictions for novel radiotherapy treatments in heterogeneous phantoms using conditional 3D-UNet generative adversarial networks","volume":"49","author":"Mentzel","year":"2022","journal-title":"Med. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2646","DOI":"10.1002\/mp.14781","article-title":"Dose calculation in proton therapy using a discovery cross-domain generative adversarial network (DiscoGAN)","volume":"48","author":"Zhang","year":"2021","journal-title":"Med. Phys."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e12917","DOI":"10.1111\/exsy.12917","article-title":"A lightweight intelligent intrusion detection system for industrial internet of things using deep learning algorithms","volume":"39","author":"Silva","year":"2022","journal-title":"Expert Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"S116","DOI":"10.1111\/epi.16555","article-title":"Machine learning and wearable devices of the future","volume":"62","author":"Beniczky","year":"2021","journal-title":"Epilepsia"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1729","DOI":"10.1007\/s11554-020-01020-8","article-title":"SD-Net: Understanding overcrowded scenes in real-time via an efficient dilated convolutional neural network","volume":"18","author":"Khan","year":"2021","journal-title":"J. Real-Time Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1140\/epjc\/s10052-021-09770-w","article-title":"Model compression and simplification pipelines for fast deep neural network inference in FPGAs in HEP","volume":"81","author":"Francescato","year":"2021","journal-title":"Eur. Phys. J. C"},{"key":"ref_11","unstructured":"Morris, C., Ritzert, M., Fey, M., Hamilton, W.L., Lenssen, J.E., Rattan, G., and Grohe, M. (2021). Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networks. arXiv."},{"key":"ref_12","unstructured":"Kipf, T.N., and Welling, M. (2017). Semi-Supervised Classification with Graph Convolutional Networks. arXiv."},{"key":"ref_13","unstructured":"Defferrard, M., Bresson, X., and Vandergheynst, P. (2017). Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering. arXiv."},{"key":"ref_14","unstructured":"Veli\u010dkovi\u0107, P., Cucurull, G., Casanova, A., Romero, A., Li\u00f2, P., and Bengio, Y. (2018). Graph Attention Networks. arXiv."},{"key":"ref_15","unstructured":"Zhu, Y., Du, Y., Wang, Y., Xu, Y., Zhang, J., Liu, Q., and Wu, S. (2022). A Survey on Deep Graph Generation: Methods and Applications. arXiv."},{"key":"ref_16","unstructured":"Kipf, T.N., and Welling, M. (2016). Variational Graph Auto-Encoders. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1944","DOI":"10.1109\/TPAMI.2007.1115","article-title":"Weighted Graph Cuts without Eigenvectors A Multilevel Approach","volume":"29","author":"Dhillon","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, M., Cui, Z., Neumann, M., and Chen, Y. (2018, January 2\u20137). An End-to-End Deep Learning Architecture for Graph Classification. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11782"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2195","DOI":"10.1109\/TNNLS.2020.3044146","article-title":"Hierarchical Representation Learning in Graph Neural Networks with Node Decimation Pooling","volume":"33","author":"Bianchi","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_20","unstructured":"Bravo-Hermsdorff, G., and Gunderson, L.M. (2020). A Unifying Framework for Spectrum-Preserving Graph Sparsification and Coarsening. arXiv."},{"key":"ref_21","unstructured":"Ying, R., You, J., Morris, C., Ren, X., Hamilton, W.L., and Leskovec, J. (2019). Hierarchical Graph Representation Learning with Differentiable Pooling. arXiv."},{"key":"ref_22","unstructured":"Gao, H., and Ji, S. (2019). Graph U-Nets. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ranjan, E., Sanyal, S., and Talukdar, P. (2020, January 7\u201312). Asap: Adaptive structure aware pooling for learning hierarchical graph representations. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i04.5997"},{"key":"ref_24","unstructured":"Guo, Y., Zou, D., and Lerman, G. (2022). An Unpooling Layer for Graph Generation. arXiv."},{"key":"ref_25","unstructured":"Liu, Q., Allamanis, M., Brockschmidt, M., and Gaunt, A.L. (2019). Constrained Graph Variational Autoencoders for Molecule Design. arXiv."},{"key":"ref_26","unstructured":"Bresson, X., and Laurent, T. (2019). A Two-Step Graph Convolutional Decoder for Molecule Generation. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Guo, X., Zhao, L., Qin, Z., Wu, L., Shehu, A., and Ye, Y. (2020, January 6\u201310). Interpretable Deep Graph Generation with Node-Edge Co-Disentanglement. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual.","DOI":"10.1145\/3394486.3403221"},{"key":"ref_28","unstructured":"Assouel, R., Ahmed, M., Segler, M.H., Saffari, A., and Bengio, Y. (2018). DEFactor: Differentiable Edge Factorization-based Probabilistic Graph Generation. arXiv."},{"key":"ref_29","unstructured":"Du, Y., Guo, X., Cao, H., Ye, Y., and Zhao, L. (March, January 22). Disentangled Spatiotemporal Graph Generative Models. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully Convolutional Networks for Semantic Segmentation","volume":"39","author":"Shelhamer","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lin, B., Gao, F., Yang, Y., Wu, D., Zhang, Y., Feng, G., Dai, T., and Du, X. (2021). FLASH Radiotherapy: History and Future. Front. Oncol., 11.","DOI":"10.3389\/fonc.2021.644400"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/S0168-9002(03)01368-8","article-title":"Geant4\u2014A simulation toolkit","volume":"506","author":"Agostinelli","year":"2003","journal-title":"Nucl. Instruments Methods Phys. Res. Sect. A Accel. Spectrometers Detect. Assoc. Equip."},{"key":"ref_33","unstructured":"Li, Y., and Mandt, S. (2018). Disentangled Sequential Autoencoder. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1118\/1.598248","article-title":"A technique for the quantitative evaluation of dose distributions","volume":"25","author":"Low","year":"1998","journal-title":"Med. Phys."},{"key":"ref_35","unstructured":"Higgins, I., Matthey, L., Pal, A., Burgess, C., Glorot, X., Botvinick, M., Mohamed, S., and Lerchner, A. (2017, January 24\u201326). beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework. Proceedings of the International Conference on Learning Representations, Toulon, France."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/3\/143\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:49:23Z","timestamp":1760122163000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/3\/143"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,6]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["a16030143"],"URL":"https:\/\/doi.org\/10.3390\/a16030143","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2023,3,6]]}}}