{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T15:51:26Z","timestamp":1776527486335,"version":"3.51.2"},"reference-count":42,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2016,2,17]],"date-time":"2016-02-17T00:00:00Z","timestamp":1455667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Augmented user experiences in the cultural heritage domain are in increasing demand by the new digital native tourists of 21st century. In this paper, we propose a novel solution that aims at assisting the visitor during an outdoor tour of a cultural site using the unique first person perspective of wearable cameras. In particular, the approach exploits computer vision techniques to retrieve the details by proposing a robust descriptor based on the covariance of local features. Using a lightweight wearable board, the solution can localize the user with respect to the 3D point cloud of the historical landmark and provide him with information about the details at which he is currently looking. Experimental results validate the method both in terms of accuracy and computational effort. Furthermore, user evaluation based on real-world experiments shows that the proposal is deemed effective in enriching a cultural experience.<\/jats:p>","DOI":"10.3390\/s16020237","type":"journal-article","created":{"date-parts":[[2016,2,18]],"date-time":"2016-02-18T22:19:47Z","timestamp":1455833987000},"page":"237","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Exploring Architectural Details Through a Wearable Egocentric Vision Device"],"prefix":"10.3390","volume":"16","author":[{"given":"Stefano","family":"Alletto","sequence":"first","affiliation":[{"name":"Department of Engineering, Universit\u00e0 degli Studi di Modena e Reggio Emilia, Via Vivarelli 10, Modena 41125, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Davide","family":"Abati","sequence":"additional","affiliation":[{"name":"Department of Engineering, Universit\u00e0 degli Studi di Modena e Reggio Emilia, Via Vivarelli 10, Modena 41125, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giuseppe","family":"Serra","sequence":"additional","affiliation":[{"name":"Department of Engineering, Universit\u00e0 degli Studi di Modena e Reggio Emilia, Via Vivarelli 10, Modena 41125, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rita","family":"Cucchiara","sequence":"additional","affiliation":[{"name":"Department of Engineering, Universit\u00e0 degli Studi di Modena e Reggio Emilia, Via Vivarelli 10, Modena 41125, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,2,17]]},"reference":[{"key":"ref_1","unstructured":"How the Americans Will Travel 2015. Available online: http:\/\/tourism-intelligence.com\/."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bl\u00f6ckner, M., Danti, S., Forrai, J., Broll, G., and de Luca, A. (2009, January 15\u201318). Please Touch the Exhibits! Using NFC-based Interaction for Exploring a Museum. Proceedings of the MobileHCI, Bonn, Germany.","DOI":"10.1145\/1613858.1613943"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kortbek, K.J., and Gr\u00f8nb\u00e6k, K. (2008, January 26\u201331). Interactive Spatial Multimedia for Communication of Art in the Physical Museum Space. Proceedings of the ACM Multimedia, Vancouver, BC, Canada.","DOI":"10.1145\/1459359.1459441"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kuusik, A., Roche, S., and Weis, F. (2009, January 24\u201326). Smartmuseum: Cultural content recommendation system for mobile users. Proceedings of the Conference on Computer Sciences and Convergence Information Technology, Seoul, Korea.","DOI":"10.1109\/ICCIT.2009.257"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, Y., Yang, C., Liu, S., Wang, R., and Meng, X. (2007, January 26\u201327). A RFID & handheld device-based museum guide system. Proceedings of the Conference on Pervasive Computing and Applications, Birmingham, UK.","DOI":"10.1109\/ICPCA.2007.4365459"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Caviglione, L., Coccoli, M., and Grosso, A. (2011, January 15\u201316). A framework for the delivery of contents in RFID-driven smart environments. Proceedings of the IEEE International Conference on RFID-Technologies and Applications, Sitges, Spain.","DOI":"10.1109\/RFID-TA.2011.6068614"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Betancourt, A., L\u00f3pez, M.M., Regazzoni, C.S., and Rauterberg, M. (2014, January 23\u201328). A sequential classifier for hand detection in the framework of egocentric vision. Proceedings of the Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.92"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4082","DOI":"10.1016\/j.patcog.2015.06.006","article-title":"Understanding social relationships in egocentric vision","volume":"48","author":"Alletto","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Fathi, A., Hodgins, J., and Rehg, J. (2012, January 20\u201325). Social interactions: A first-person perspective. Proceedings of the CVPR, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2012.6247805"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lee, Y.J., and Grauman, K. (2015). Predicting important objects for egocentric video summarization. Int. J. Comput. Vis., 1\u201318.","DOI":"10.1007\/s11263-014-0794-5"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Alletto, S., Abati, D., Serra, G., and Cucchiara, R. (2015, January 10\u201312). Wearable Vision for Retrieving Architectural Details in Augmented Tourist Experiences. Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment, Turin, Italy.","DOI":"10.4108\/icst.intetain.2015.260034"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1016\/j.ins.2014.02.112","article-title":"Building recognition in urban environments: A survey of state-of-the-art and future challenges","volume":"277","author":"Li","year":"2014","journal-title":"Inf. Sci."},{"key":"ref_13","unstructured":"Goedem\u00e9, T., Tuytelaars, T., and van Gool, L. (July, January 27). Fast wide baseline matching for visual navigation. Proceedings of the CVPR, Washington, DC, USA."},{"key":"ref_14","unstructured":"Shao, H., Svoboda, T., Tuytelaars, T., and Van Gool, L. (2003). Image and Video Retrieval, Springer."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.ins.2013.08.020","article-title":"Recognizing architecture styles by hierarchical sparse coding of blocklets","volume":"254","author":"Zhang","year":"2014","journal-title":"Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1016\/j.amc.2008.05.059","article-title":"Facet-based multiple building analysis for robot intelligence","volume":"205","author":"Trinh","year":"2008","journal-title":"Appl. Math. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1109\/TII.2013.2245910","article-title":"Building recognition using local oriented features","volume":"9","author":"Li","year":"2013","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kim, Y., Lee, K., Choi, K., and Cho, S.I. (2006, January 20\u201322). Building recognition for augmented reality based navigation system. Proceedings of the Computer and Information Technology, Seoul, Krea.","DOI":"10.1109\/CIT.2006.58"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. (2007, January 1\u20138). Object retrieval with large vocabularies and fast spatial matching. Proceedings of the CVPR, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383172"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1016\/j.imavis.2006.05.016","article-title":"Hierarchical building recognition","volume":"25","author":"Zhang","year":"2007","journal-title":"Image Vis. Comput."},{"key":"ref_21","unstructured":"Chung, Y.C., Han, T.X., and He, Z. (October, January 29). Building recognition using sketch-based representations and spectral graph matching. Proceedings of the ICCV, Kyoto, Japan."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.neucom.2009.08.016","article-title":"Subspace learning-based dimensionality reduction in building recognition","volume":"73","author":"Li","year":"2009","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Groeneweg, N.J., de Groot, B., Halma, A.H., Quiroga, B.R., Tromp, M., and Groen, F.C. (2006). A fast offline building recognition application on a mobile telephone. Advanced Concepts for Intelligent Vision Systems, Springer.","DOI":"10.1007\/11864349_102"},{"key":"ref_24","unstructured":"Li, J., and Allinson, N.M. (2010). Visual Communications and Image Processing 2010, International Society for Optics and Photonics."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Weyand, T., and Leibe, B. (2014). Visual Landmark Recognition from Internet Photo Collections: A Large-Scale Evaluation. Comput. Vision Image Understanding.","DOI":"10.1016\/j.cviu.2015.02.002"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Weyand, T., and Leibe, B. (2013, January 1\u20138). Discovering Details and Scene Structure with Hierarchical Iconoid Shift. Proceedings of the ICCV, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.432"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Mikul\u00edk, A., Radenovi\u0107, F., Chum, O., and Matas, J. (2014, January 1\u20135). Efficient Image Detail Mining. Proceedings of the ACCV, Singapore.","DOI":"10.1007\/978-3-319-16808-1_9"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hartley, R.I., and Zisserman, A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Irschara, A., Zach, C., michael Frahm, J., and Bischof, H. (2009, January 20\u201325). From structure-from-motion point clouds to fast location recognition. Proceedings of the CVPR, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206587"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kukelova, Z., Bujnak, M., and Pajdla, T. (2013, January 1\u20138). Real-Time Solution to the Absolute Pose Problem with Unknown Radial Distortion and Focal Length. Proceedings of the ICCV, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.350"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1713","DOI":"10.1109\/TPAMI.2008.75","article-title":"Pedestrian Detection via Classification on Riemannian Manifolds","volume":"30","author":"Tuzel","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","unstructured":"Martelli, S., Tosato, D., Farenzena, M., Cristani, M., and Murino, V. (September, January 30). An FPGA-based Classification Architecture on Riemannian Manifolds. Proceedings of the DEXA Workshops, Bilbao, Spain."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hastie, T.J., Tibshirani, R.J., and Friedman, J.H. (2009). The Elements of Statistical Learning : Data Mining, Inference, and Prediction, Springer.","DOI":"10.1007\/978-0-387-84858-7"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2227","DOI":"10.1109\/TPAMI.2014.2321376","article-title":"Scalable Nearest Neighbor Algorithms for High Dimensional Data","volume":"36","author":"Muja","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/TPAMI.2011.153","article-title":"Efficient Additive Kernels via Explicit Feature Maps","volume":"34","author":"Vedaldi","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","unstructured":"Brown, M., and Lowe, D.G. (2005, January 13\u201316). Unsupervised 3D object recognition and reconstruction in unordered datasets. Proceedings of the 3-D Digital Imaging and Modeling, Ottawa, ON, Canada."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1145\/1141911.1141964","article-title":"Photo tourism: Exploring photo collections in 3D","volume":"25","author":"Snavely","year":"2006","journal-title":"ACM Trans. Graph."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s11263-007-0107-3","article-title":"Modeling the world from internet photo collections","volume":"80","author":"Snavely","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1023\/B:VISI.0000025798.50602.3a","article-title":"Visual modeling with a hand-held camera","volume":"59","author":"Pollefeys","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wu, C., Agarwal, S., Curless, B., and Seitz, S. (2011, January 20\u201325). Multicore bundle adjustment. Proceedings of the CVPR, Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995552"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.1109\/TPAMI.2009.154","article-title":"Evaluating Color Descriptors for Object and Scene Recognition","volume":"32","author":"Gevers","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/2\/237\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:19:14Z","timestamp":1760210354000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/2\/237"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,2,17]]},"references-count":42,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2016,2]]}},"alternative-id":["s16020237"],"URL":"https:\/\/doi.org\/10.3390\/s16020237","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,2,17]]}}}