{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T05:05:20Z","timestamp":1787029520461,"version":"build-2736575974"},"reference-count":57,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,21]],"date-time":"2021-12-21T00:00:00Z","timestamp":1640044800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>An increased interest in computer-aided heritage reconstruction has emerged in recent years due to the maturity of sophisticated computer vision techniques. Concretely, feature-based matching methods have been conducted to reassemble heritage assets, yielding plausible results for data that contains enough salient points for matching. However, they fail to register ancient artifacts that have been badly deteriorated over the years. In particular, for monochromatic incomplete data, such as 3D sunk relief eroded decorations, damaged drawings, and ancient inscriptions. The main issue lies in the lack of regions of interest and poor quality of the data, which prevent feature-based algorithms from estimating distinctive descriptors. This paper addresses the reassembly of damaged decorations by deploying a Generative Adversarial Network (GAN) to predict the continuing decoration traces of broken heritage fragments. By extending the texture information of broken counterpart fragments, it is demonstrated that registration methods are now able to find mutual characteristics that allow for accurate optimal rigid transformation estimation for fragments alignment. This work steps away from feature-based approaches, hence employing Mutual Information (MI) as a similarity metric to estimate an alignment transformation. Moreover, high-resolution geometry and imagery are combined to cope with the fragility and severe damage of heritage fragments. Therefore, the testing data is composed of a set of ancient Egyptian decorated broken fragments recorded through 3D remote sensing techniques. More specifically, structured light technology for mesh models creation, as well as orthophotos, upon which digital drawings are created. Even though this study is restricted to Egyptian artifacts, the workflow can be applied to reconstruct different types of decoration patterns in the cultural heritage domain.<\/jats:p>","DOI":"10.3390\/rs14010006","type":"journal-article","created":{"date-parts":[[2021,12,21]],"date-time":"2021-12-21T09:50:43Z","timestamp":1640080243000},"page":"6","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A Generative and Entropy-Based Registration Approach for the Reassembly of Ancient Inscriptions"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5494-9172","authenticated-orcid":false,"given":"Roberto","family":"de Lima-Hernandez","sequence":"first","affiliation":[{"name":"Department of Civil Engineering, Section Geomatics, KU Leuven\u2014Faculty of Engineering Technology, 9000 Ghent, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3465-9033","authenticated-orcid":false,"given":"Maarten","family":"Vergauwen","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Section Geomatics, KU Leuven\u2014Faculty of Engineering Technology, 9000 Ghent, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1109\/TVCG.2016.2598603","article-title":"Visualization and extraction of carvings for heritage conservation","volume":"23","author":"Lawonn","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1109\/34.982888","article-title":"Reconstruction of three-dimensional objects through matching of their parts","volume":"24","author":"Papaioannou","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3569","DOI":"10.1109\/TIP.2019.2963378","article-title":"Deepzzle: Solving visual jigsaw puzzles with deep learning and shortest path optimization","volume":"29","author":"Paumard","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1007\/s11263-015-0824-y","article-title":"A comprehensive performance evaluation of 3D local feature descriptors","volume":"116","author":"Guo","year":"2016","journal-title":"Int. J. Comput. Vis."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s11263-020-01359-2","article-title":"Image matching from handcrafted to deep features: A survey","volume":"129","author":"Ma","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_6","unstructured":"Huang, Q.X., Fl\u00f6ry, S., Gelfand, N., Hofer, M., and Pottmann, H. (2006). ACM SIGGRAPH 2006 Papers, Association for Computing Machinery."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"563","DOI":"10.5194\/isprs-archives-XLII-2-W15-563-2019","article-title":"Puzzling Engine: A Digital Platform to Aid the Reassembling of Fractured Fragments","volume":"42","author":"Hernandez","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.patcog.2017.08.008","article-title":"Recognition of feature curves on 3D shapes using an algebraic approach to Hough transforms","volume":"73","author":"Torrente","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.patcog.2018.04.028","article-title":"Description and retrieval of geometric patterns on surface meshes using an edge-based LBP approach","volume":"82","author":"Thompson","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_10","unstructured":"(2021, November 17). Gravitate Geometric Reconstruction and NoVel SemantIc ReunificaTion of culturAl heriTage objEcts. Available online: https:\/\/cordis.europa.eu\/project\/id\/665155."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.patrec.2020.07.008","article-title":"SAFFO: A SIFT based approach for digital anastylosis for fresco recOnstruction","volume":"138","author":"Barra","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3003435","article-title":"Multi-view feature combination for ancient paintings chronological classification","volume":"10","author":"Chen","year":"2017","journal-title":"J. Comput. Cult. Herit. (JOCCH)"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.culher.2020.01.006","article-title":"Implementation of ultra-light UAV systems for cultural heritage documentation","volume":"44","author":"Bakirman","year":"2020","journal-title":"J. Cult. Herit."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, R., Liu, S., Wang, G., Liu, G., and Zeng, B. (2021). JigsawGAN: Self-supervised Learning for Solving Jigsaw Puzzles with Generative Adversarial Networks. arXiv.","DOI":"10.1109\/TIP.2021.3120052"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/MSP.2017.2765202","article-title":"Generative adversarial networks: An overview","volume":"35","author":"Creswell","year":"2018","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1016\/j.patrec.2020.01.012","article-title":"Matching ostraca fragments using a siamese neural network","volume":"131","author":"Ostertag","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_18","unstructured":"(2021, December 10). Archaide New System for the Automatic Recognition of Archaeological Pottery. Available online: http:\/\/www.archaide.eu\/."},{"key":"ref_19","first-page":"35","article-title":"From Textural Inpainting to Deep Generative Models: An Extensive Survey of Image Inpainting Techniques","volume":"16","author":"Mehra","year":"2020","journal-title":"Int. J. Trends Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3998","DOI":"10.1002\/mp.13656","article-title":"Paired cycle-GAN-based image correction for quantitative cone-beam computed tomography","volume":"46","author":"Harms","year":"2019","journal-title":"Med. Phys."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Qu, Y., Chen, Y., Huang, J., and Xie, Y. (2019, January 16\u201317). Enhanced pix2pix dehazing network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00835"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"48451","DOI":"10.1109\/ACCESS.2020.2979348","article-title":"PiiGAN: Generative adversarial networks for pluralistic image inpainting","volume":"8","author":"Cai","year":"2020","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, F., Deng, X., Lai, Y.K., Liu, Y.J., Ma, C., and Wang, H. (2019, January 16\u201317). Sketchgan: Joint sketch completion and recognition with generative adversarial network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00598"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40494-020-0355-x","article-title":"Ancient mural restoration based on a modified generative adversarial network","volume":"8","author":"Cao","year":"2020","journal-title":"Herit. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1007\/s13042-019-01032-2","article-title":"A global and local feature weighted method for ancient murals inpainting","volume":"11","author":"Wang","year":"2020","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.culher.2020.09.015","article-title":"FRAGMENTS: A fully automatic photogrammetric fragments recomposition workflow","volume":"47","author":"Abate","year":"2021","journal-title":"J. Cult. Herit."},{"key":"ref_27","first-page":"762335","article-title":"Image similarity metrics in image registration","volume":"7623","author":"Melbourne","year":"2010","journal-title":"Medical Imaging 2010: Image Processing"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.1080\/01431161.2018.1437295","article-title":"Medium-low resolution multisource remote sensing image registration based on SIFT and robust regional mutual information","volume":"39","author":"Chen","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1729881417746270","DOI":"10.1177\/1729881417746270","article-title":"Two-dimensional forward-looking sonar image registration by maximization of peripheral mutual information","volume":"14","author":"Song","year":"2017","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bassier, M., Vincke, S., de Lima Hernandez, R., and Vergauwen, M. (2018). An overview of innovative heritage deliverables based on remote sensing techniques. Remote Sens., 10.","DOI":"10.3390\/rs10101607"},{"key":"ref_31","unstructured":"Newberry, P.E. (1893). El Bersheh: Part I. The Tomb of Tehuti-Hetep, Egypt Exploration Fund."},{"key":"ref_32","unstructured":"(2021, October 05). Dayr Al-Barsha Project an Interdisciplinary Archaeological Research Project in Middle Egypt. Available online: https:\/\/www.arts.kuleuven.be\/dayr-al-barsha."},{"key":"ref_33","unstructured":"Meyer, M., Desbrun, M., Schr\u00f6der, P., and Barr, A.H. (2003). Visualization and Mathematics III, Springer."},{"key":"ref_34","unstructured":"Ohtake, Y., Belyaev, A., and Seidel, H.P. (2004). ACM SIGGRAPH 2004 Papers, Association for Computing Machinery."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"e6","DOI":"10.5334\/jors.ae","article-title":"IJBlob: An ImageJ library for connected component analysis and shape analysis","volume":"1","author":"Wagner","year":"2013","journal-title":"J. Open Res. Softw."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1111\/1467-8659.00334","article-title":"Improved laplacian smoothing of noisy surface meshes","volume":"18","author":"Vollmer","year":"1999","journal-title":"Computer Graphics Forum"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.cag.2012.02.012","article-title":"CudaHull: Fast parallel 3D convex hull on the GPU","volume":"36","author":"Stein","year":"2012","journal-title":"Comput. Graph."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sasaki, K., Iizuka, S., Simo-Serra, E., and Ishikawa, H. (2017, January 21\u201326). Joint Gap Detection and Inpainting of Line Drawings. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.611"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.patrec.2019.01.006","article-title":"A hybrid convolutional neural network for sketch recognition","volume":"130","author":"Zhang","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_40","unstructured":"Li, L., Zou, C., Zheng, Y., Su, Q., Fu, H., and Tai, C.L. (2018). Sketch-R2CNN: An attentive network for vector sketch recognition. arXiv."},{"key":"ref_41","first-page":"44:1","article-title":"How Do Humans Sketch Objects?","volume":"31","author":"Eitz","year":"2012","journal-title":"ACM Trans. Graph. Proc. SIGGRAPH"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"123438","DOI":"10.1109\/ACCESS.2021.3110082","article-title":"A Deep Learning Approach to Ancient Egyptian Hieroglyphs Classification","volume":"9","author":"Barucci","year":"2021","journal-title":"IEEE Access"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1179\/tav.1984.1984.1.77","article-title":"Hieratic inscriptions from Tel Sera\u2019in southern Canaan","volume":"11","author":"Goldwasser","year":"1984","journal-title":"Tel Aviv"},{"key":"ref_44","unstructured":"Cook, B.F. (1987). Greek Inscriptions, University of California Press."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Hore, A., and Ziou, D. (2010, January 23\u201326). Image quality metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1111","DOI":"10.1109\/TMI.2003.816949","article-title":"Mutual information-based CT-MR brain image registration using generalized partial volume joint histogram estimation","volume":"22","author":"Chen","year":"2003","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_48","unstructured":"(2021, October 05). Trimesh2 A C++ Library and Set of Utilities for Input, Output, and Basic Manipulation of 3D Triangle Meshes. Available online: https:\/\/gfx.cs.princeton.edu\/proj\/trimesh2\/."},{"key":"ref_49","unstructured":"(2021, October 05). OpenCV Computer Vision Library. Available online: https:\/\/opencv.org\/."},{"key":"ref_50","unstructured":"(2021, October 05). TensorFlow an End-to-End Open Source Machine Learning Platform. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_52","unstructured":"(2021, October 05). Numpy The Fundamental Package for Scientific Computing with Python. Available online: https:\/\/numpy.org\/."},{"key":"ref_53","unstructured":"(2021, October 05). Scikit-Learn Machine Learning in Python. Available online: https:\/\/scikit-learn.org\/."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Grilli, E., Dininno, D., Marsicano, L., Petrucci, G., and Remondino, F. (2018, January 26\u201330). Supervised segmentation of 3D cultural heritage. Proceedings of the 2018 3rd Digital Heritage International Congress (DigitalHERITAGE) Held Jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018), San Francisco, CA, USA.","DOI":"10.1109\/DigitalHeritage.2018.8810107"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"58","DOI":"10.4018\/IJCMHS.2019070104","article-title":"Serious games classification for digital heritage","volume":"3","author":"Paliokas","year":"2019","journal-title":"Int. J. Comput. Methods Herit. Sci. IJCMHS"},{"key":"ref_56","first-page":"42","article-title":"Approaches Used to Recognise and Decipher Ancient Inscriptions: A Review","volume":"23","author":"Heenkenda","year":"2020","journal-title":"Vidyodaya J. Sci."},{"key":"ref_57","first-page":"3063","article-title":"VeCHArt: Visually enhanced comparison of historic art using an automated line-based synchronization technique","volume":"26","author":"Thom","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/1\/6\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:50:23Z","timestamp":1760169023000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/1\/6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,21]]},"references-count":57,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["rs14010006"],"URL":"https:\/\/doi.org\/10.3390\/rs14010006","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,21]]}}}