{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,16]],"date-time":"2025-11-16T06:22:00Z","timestamp":1763274120304,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,6,25]],"date-time":"2020-06-25T00:00:00Z","timestamp":1593043200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Imaging techniques and Image Based-Modeling (IBM) practices in the field of Cultural Heritage (CH) studies are nowadays no longer used as one-shot applications but as various and complex scenarios involving multiple modalities; sensors, scales, spectral bands and temporalities utilized by various experts. Current use of Structure from Motion and photogrammetric methods necessitates some improvements in iterative registration to ease the growing complexity in the management of the scientific imaging applied on heritage assets. In this context, the co-registration of photo-documentation among other imaging resources is a key step in order to move towards data fusion and collaborative semantic enrichment scenarios. This paper presents the recent development of a Totally Automated Co-registration and Orientation library (TACO) based on the interoperability of open-source solutions to conduct photogrammetric-based registration. The proposed methodology addresses and solves some gaps in term of robustness and versatility in the field of incremental and global orientation of image-sets dedicated to CH practices.<\/jats:p>","DOI":"10.3390\/rs12122051","type":"journal-article","created":{"date-parts":[[2020,6,25]],"date-time":"2020-06-25T10:36:54Z","timestamp":1593081414000},"page":"2051","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Robust and Versatile Pipeline for Automatic Photogrammetric-Based Registration of Multimodal Cultural Heritage Documentation"],"prefix":"10.3390","volume":"12","author":[{"given":"Anthony","family":"Pamart","sequence":"first","affiliation":[{"name":"Mod\u00e8les et simulations pour l\u2019Architecture et le Patrimoine, UMR 3495 CNRS\/MC, 13402 Marseille, France"}]},{"given":"Fran\u00e7ois","family":"Morlet","sequence":"additional","affiliation":[{"name":"Centre Interdisciplinaire de Conservation et de Restauration du Patrimoine, LABCOM CICRP\/MAP, 13003 Marseille, France"}]},{"given":"Livio","family":"De Luca","sequence":"additional","affiliation":[{"name":"Mod\u00e8les et simulations pour l\u2019Architecture et le Patrimoine, UMR 3495 CNRS\/MC, 13402 Marseille, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4062-2432","authenticated-orcid":false,"given":"Philippe","family":"Veron","sequence":"additional","affiliation":[{"name":"LISPEN (EA 7515), Arts et M\u00e9tiers Institute of Technology, 13617 Aix-en-Provence, France"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,25]]},"reference":[{"key":"ref_1","unstructured":"Pamart, A., Guillon, O., Vallet, J.M., and De Luca, L. (2016, January 5\u20137). Toward a multimodal photogrammetric acquisition and processing methodology for monitoring conservation and restoration studies. Proceedings of the 14th Eurographics Workshop on Graphics and Cultural Heritage, Genova, Italy."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pamart, A., Guillon, O., Faraci, S., Gattet, E., Genevois, M., Vallet, J.M., and De Luca, L. (2017). Multispectral Photogrammetric Data Acquisition and Processing for Wall Paintings Studies, ISPRS-International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.","DOI":"10.5194\/isprs-archives-XLII-2-W3-559-2017"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Pamart, A., Ponchio, F., Abergel, V., Alaoui M\u2019Darhri, A., Corsini, M., Dellepiane, M., Morlet, F., Scopigno, R., and De Luca, L. (2019). A complete framework operating Spatially-Oriented RTI in a 3D\/2D Cultural Heritage documentation and analysis tool. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci., XLII-2\/W9, in press.","DOI":"10.5194\/isprs-archives-XLII-2-W9-573-2019"},{"key":"ref_4","unstructured":"Grussenmeyer, P., Drap, P., and Gaillard, G. (2002). ARPENTEUR 3.0: Recent Developments in Web Based Photogrammetry, ISPRS, Commission VI: Education and Communications."},{"key":"ref_5","unstructured":"Nilsson, D., Pletinckx, D., Van Gool, L., and Vergauwen, M. (2020, June 23). The ARC 3D Webservice. Available online: http:\/\/www.her-it-age.net\/."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Heller, J., Havlena, M., Jancosek, M., Torii, A., and Pajdla, T. (2015, January 18\u201322). 3D reconstruction from photographs by CMP SfM web service. Proceedings of the 2015 14th IAPR International Conference on Machine Vision Applications (MVA), Tokyo, Japan.","DOI":"10.1109\/MVA.2015.7153126"},{"key":"ref_7","first-page":"64","article-title":"Culture 3D Cloud: A Cloud Computing Platform for 3D Scanning, Documentation, Preservation and Dissemination of Cultural Heritage","volume":"111","author":"Alliez","year":"2017","journal-title":"ERCIM News"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"187","DOI":"10.5194\/isprs-archives-XLII-2-W8-187-2017","article-title":"3D reconstruction with a collaborative approach based on smartphones and a cloud-based server","volume":"XLII-2\/W8","author":"Nocerino","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Moulon, P., Monasse, P., Perrot, R., and Marlet, R. (2016). OpenMVG: Open multiple view geometry. International Workshop on Reproducible Research in Pattern Recognition, Springer.","DOI":"10.1007\/978-3-319-56414-2_5"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1186\/s40965-017-0027-2","article-title":"MicMac\u2014A free, open-source solution for photogrammetry","volume":"2","author":"Rupnik","year":"2017","journal-title":"Open Geospat. Data Softw. Stand."},{"key":"ref_11","first-page":"92","article-title":"Relationship between photogrammmetry and computer vision. Integrating photogrammetric techniques with scene analysis and machine vision","volume":"1944","author":"Hartley","year":"1993","journal-title":"Int. Soc. Opt. Photonics"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/phor.12092","article-title":"Computer vision and photogrammetry: Interaction or introspection?","volume":"30","author":"Granshaw","year":"2015","journal-title":"Photogramm. Rec."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.culher.2017.11.006","article-title":"Recent trends in cultural heritage 3D survey: The photogrammetric computer vision approach","volume":"32","author":"Aicardi","year":"2018","journal-title":"J. Cult. Herit."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s11263-007-0107-3","article-title":"Modeling the world from internet photo collections","volume":"80","author":"Snavely","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgibbon, A.W. (1999). Bundle adjustment\u2014A modern synthesis. International Workshop on Vision Algorithms, Springer.","DOI":"10.1007\/3-540-44480-7_21"},{"key":"ref_16","first-page":"266","article-title":"Digital camera calibration methods: Considerations and comparisons","volume":"36","author":"Remondino","year":"2006","journal-title":"Int. Arch. Photogramm. Remote. Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1111\/phor.12231","article-title":"GRAPHOS\u2013open-source software for photogrammetric applications","volume":"33","author":"Guerrero","year":"2018","journal-title":"Photogramm. Rec."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gonzalez-Aguilera, D., Ruiz de Ona, E., L\u00f3pez-Fernandez, L., Farella, E.M., Stathopoulou, E.K., Toschi, I., Remondino, F., Rodr\u00edguez-Gonz\u00e1lvez, P., Hern\u00e1ndez-L\u00f3pez, D., and Fusiello, A. (2020). PhotoMatch\u2014An open-source multi-view and multi-modal feature matching tool for photogrammetric applications. ISPRS Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., in press.","DOI":"10.5194\/isprs-archives-XLIII-B5-2020-213-2020"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1111\/j.1477-9730.2006.00383.x","article-title":"Image-based 3D Modelling: A Review","volume":"21","author":"Remondino","year":"2006","journal-title":"Photogramm. Rec."},{"key":"ref_20","unstructured":"Remondino, F., Nocerino, E., Toschi, I., and Menna, F. (September, January 28). A critical review of automated photogrammetric processing of large datasets. Proceedings of the 26th International CIPA Symposium 2017, Ottawa, ON, Canada."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"331","DOI":"10.5194\/isprs-archives-XLII-2-W17-331-2019","article-title":"Open-Source Image-Based 3d Reconstruction Pipelines: Review, Comparison and Evaluation","volume":"42","author":"Stathopoulou","year":"2019","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_22","first-page":"62","article-title":"Geometric and radiometric analysis of paintings","volume":"38","author":"Barazzetti","year":"2010","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"773","DOI":"10.5194\/isprs-archives-XLII-2-773-2018","article-title":"Mapping VIS and UVL imagery on 3D geometry for non-invasive, non-contact analysis of a vase","volume":"42","author":"Nocerino","year":"2018","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.culher.2018.04.014","article-title":"Construction and comparison of 3D multi-source multi-band models for cultural heritage applications","volume":"34","author":"Grifoni","year":"2018","journal-title":"J. Cult. Herit."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.imavis.2012.10.006","article-title":"Integration of 3D and multispectral data for cultural heritage applications: Survey and perspectives","volume":"31","author":"Chane","year":"2013","journal-title":"Image Vis. Comput."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yeh, C.K., Matsuda, N., Huang, X., Li, F., Walton, M., and Cossairt, O. (2016, January 11\u201314). A streamlined photometric stereo framework for cultural heritage. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46604-0_51"},{"key":"ref_27","unstructured":"Van der Perre, A., Hameeuw, H., Boschloos, V., Delvaux, L., Proesmans, M., Vandermeulen, B., Van Gool, L., and Watteeuw, L. (2016). Towards a combined use of IR, UV and 3D-Imaging for the study of small inscribed and illuminated artefacts. Lights On\u2026 Cultural Heritage and Museums!, LabCR Laboratory for Conservation and Restoration, FLUP Faculty of Arts and Humanities, University of Porto."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"417","DOI":"10.5194\/isprsarchives-XL-5-W7-417-2015","article-title":"Digital 3D Borobudur-Integration of 3D surveying and modeling techniques","volume":"40","author":"Suwardhi","year":"2015","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_29","first-page":"W7","article-title":"Data fusion in cultural heritage a review","volume":"5","author":"Ramos","year":"2015","journal-title":"ISPRS\u2013 Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"371","DOI":"10.5194\/isprsannals-II-5-371-2014","article-title":"On the evaluation of photogrammetric methods for dense 3D surface reconstruction in a metrological context","volume":"II-5","author":"Toschi","year":"2014","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Calvet, L., Gurdjos, P., Griwodz, C., and Gasparini, S. (2016, January 27\u201330). Detection and accurate localization of circular fiducials under highly challenging conditions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.67"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, J., and Olson, E. (2016, January 9\u201314). AprilTag 2: Efficient and robust fiducial detection. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759617"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"307","DOI":"10.5194\/isprsarchives-XL-3-W3-307-2015","article-title":"Coastal digital surface model on low contrast images","volume":"40","author":"Rosu","year":"2015","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.isprsjprs.2015.09.005","article-title":"Recent developments in large-scale tie-point matching","volume":"115","author":"Hartmann","year":"2016","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"465","DOI":"10.5194\/isprs-archives-XLII-2-W15-465-2019","article-title":"Sparse point cloud filtering based on covariance features","volume":"42","author":"Farella","year":"2019","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_37","first-page":"547","article-title":"A solution for space resection in closed form","volume":"27","author":"Shih","year":"1988","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Larsson, V., Kukelova, Z., and Zheng, Y. (2017, January 22\u201329). Making minimal solvers for absolute pose estimation compact and robust. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.254"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ke, T., and Roumeliotis, S.I. (2017). An efficient algebraic solution to the perspective-three-point problem. arXiv.","DOI":"10.1109\/CVPR.2017.491"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Persson, M., and Nordberg, K. (2018, January 8\u201314). Lambda Twist: An Accurate Fast Robust Perspective Three Point (P3P) Solver. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01225-0_20"},{"key":"ref_41","unstructured":"Palma, G., Corsini, M., Dellepiane, M., and Scopigno, R. (2010, January 18\u201319). Improving 2D-3D Registration by Mutual Information using Gradient Maps. Proceedings of the Eurographics Italian Chapter Conference, Genova, Italy."},{"key":"ref_42","first-page":"2","article-title":"Docker: Lightweight Linux Containers for Consistent Development and Deployment","volume":"2014","author":"Merkel","year":"2014","journal-title":"Linux J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"106944","DOI":"10.1016\/j.comnet.2019.106944","article-title":"MIMETIC: Mobile encrypted traffic classification using multimodal deep learning","volume":"165","author":"Aceto","year":"2019","journal-title":"Comput. Netw."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.procs.2019.01.014","article-title":"Multimodal Images Classification using Dense SURF, Spectral Information and Support Vector Machine","volume":"148","author":"Anzid","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Belhi, A., Bouras, A., and Foufou, S. (2018). Leveraging known data for missing label prediction in cultural heritage context. Appl. Sci., 8.","DOI":"10.3390\/app8101768"},{"key":"ref_46","unstructured":"Manuel, A., V\u00e9ron, P., and De Luca, L. (2016, January 5\u20137). 2D\/3D semantic annotation of spatialized images for the documentation and analysis of cultural heritage. Proceedings of the 14th Eurographics Workshop on Graphics and Cultural Heritage, Genova, Italy."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Manuel, A., M\u2019Darhri, A.A., Abergel, V., Rozar, F., and De Luca, L. (2018, January 26\u201330). A semi-automatic 2D\/3D annotation framework for the geometric analysis of heritage artefacts. Proceedings of the 2018 3rd Digital Heritage International Congress (DigitalHERITAGE), San Francisco, CA, USA.","DOI":"10.1109\/DigitalHeritage.2018.8810114"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/12\/2051\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:42:57Z","timestamp":1760175777000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/12\/2051"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,25]]},"references-count":47,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["rs12122051"],"URL":"https:\/\/doi.org\/10.3390\/rs12122051","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,6,25]]}}}