{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:32:45Z","timestamp":1760236365483,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,17]],"date-time":"2021-11-17T00:00:00Z","timestamp":1637107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Submarines are considered extremely strategic for any naval army due to their stealth capability. Periscopes are crucial sensors for these vessels, and emerging to the surface or periscope depth is required to identify visual contacts through this device. This maneuver has many procedures and usually has to be fast and agile to avoid exposure. This paper presents and implements a novel architecture for real submarine periscopes developed for future Brazilian naval fleet operations. Our system consists of a probe that is connected to the craft and carries a 360 camera. We project and take the images inside the vessel using traditional VR\/XR devices. We also propose and implement an efficient computer vision-based MR technique to estimate and display detected vessels effectively and precisely. The vessel detection model is trained using synthetic images. So, we built and made available a dataset composed of 99,000 images. Finally, we also estimate distances of the classified elements, showing all the information in an AR-based interface. Although the probe is wired-connected, it allows for the vessel to stand in deep positions, reducing its exposure and introducing a new way for submarine maneuvers and operations. We validate our proposal through a user experience experiment using 19 experts in periscope operations.<\/jats:p>","DOI":"10.3390\/s21227624","type":"journal-article","created":{"date-parts":[[2021,11,17]],"date-time":"2021-11-17T09:16:11Z","timestamp":1637140571000},"page":"7624","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["An Augmented Reality Periscope for Submarines with Extended Visual Classification"],"prefix":"10.3390","volume":"21","author":[{"given":"Andr\u00e9","family":"Breitinger","sequence":"first","affiliation":[{"name":"Instituto de Computa\u00e7\u00e3o, Universidade Federal Fluminense (UFF), Av. Gal. Milton Tavares de Souza, Niter\u00f3i 24210-346, RJ, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5650-1718","authenticated-orcid":false,"given":"Esteban","family":"Clua","sequence":"additional","affiliation":[{"name":"Instituto de Computa\u00e7\u00e3o, Universidade Federal Fluminense (UFF), Av. Gal. Milton Tavares de Souza, Niter\u00f3i 24210-346, RJ, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8491-793X","authenticated-orcid":false,"given":"Leandro A. F.","family":"Fernandes","sequence":"additional","affiliation":[{"name":"Instituto de Computa\u00e7\u00e3o, Universidade Federal Fluminense (UFF), Av. Gal. Milton Tavares de Souza, Niter\u00f3i 24210-346, RJ, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,17]]},"reference":[{"key":"ref_1","unstructured":"Estado-Maior da Armada (2017). EMA-305: Doutrina Militar Naval, Marinha do Brasil. (In Portuguese)."},{"key":"ref_2","unstructured":"(2021, August 19). USS Key West at Periscope Depth. Available online: https:\/\/pt.m.wikipedia.org\/wiki\/Ficheiro:Periscope_Depth.jpg."},{"key":"ref_3","unstructured":"BRASIL, Comando da For\u00e7a de Submarinos (2012). ComForS-730: Procedimentos Operativos Para Submarinos, Marinha do Brasil. (In Portuguese)."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1007\/s10111-017-0413-7","article-title":"Up periscope: Understanding submarine command and control teamwork during a simulated return to periscope depth","volume":"19","author":"Stanton","year":"2017","journal-title":"Cogn. Technol. Work"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1017\/S0373463314000873","article-title":"Research on wearable, immersive augmented reality (WIAR) adoption in maritime navigation","volume":"68","author":"Grabowski","year":"2015","journal-title":"J. Navig."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1017\/S0373463321000412","article-title":"Augmented reality for maritime navigation data visualisation: A systematic review, issues and perspectives","volume":"74","author":"Laera","year":"2021","journal-title":"J. Navig."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1117\/12.197321","article-title":"Augmented reality: A class of displays on the reality-virtuality continuum","volume":"Volume 2351","author":"Das","year":"1995","journal-title":"Telemanipulator and Telepresence Technologies"},{"key":"ref_9","unstructured":"International Maritime Organization (2021, June 02). Listing of Current IMO Publications. Available online: https:\/\/www.imo.org\/en\/publications\/Pages\/CurrentPublications.aspx."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.cag.2020.09.012","article-title":"Deep traffic light detection by overlaying synthetic context on arbitrary natural images","volume":"94","author":"Tabelini","year":"2021","journal-title":"Comput. Graph."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kim, K., Hong, S., Choi, B., and Kim, E. (2018). Probabilistic ship detection and classification using deep learning. Appl. Sci., 8.","DOI":"10.3390\/app8060936"},{"key":"ref_12","first-page":"415","article-title":"Image-based ship detection using deep learning","volume":"10","author":"Lee","year":"2020","journal-title":"Ocean. Syst. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ward, C.M., Harguess, J., and Hilton, C. (2018, January 22\u201325). Ship classification from overhead imagery using synthetic data and domain adaptation. Proceedings of the OCEANS 2018 MTS\/IEEE Charleston, Charleston, SC, USA.","DOI":"10.1109\/OCEANS.2018.8604662"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft COCO: Common objects in context. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_16","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_17","unstructured":"(2021, June 06). Periphoto of a Type 23 Frigate. Available online: https:\/\/www.marinha.mil.br\/ciama\/sites\/files\/periscopio_2020.pdf."},{"key":"ref_18","unstructured":"AutoIt Consulting Ltd. (2021, June 02). AutoIt Scripting Language. Available online: https:\/\/www.autoitscript.com\/site\/autoit\/."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bisong, E. (2019). Google Colaboratory. Building Machine Learning and Deep Learning Models on Google Cloud Platform, Apress.","DOI":"10.1007\/978-1-4842-4470-8"},{"key":"ref_20","unstructured":"Salman, S., and Liu, X. (2019). Overfitting Mechanism and Avoidance in Deep Neural Networks. arXiv."},{"key":"ref_21","unstructured":"Juliani, A., Berges, V.P., Teng, E., Cohen, A., Harper, J., Elion, C., Goy, C., Gao, Y., Henry, H., and Mattar, M. (2020). Unity: A General Platform for Intelligent Agents. arXiv."},{"key":"ref_22","unstructured":"(2021, July 07). Wikipedia, The Free Encyclopedia. Likert Scale. Available online: https:\/\/pt.wikipedia.org\/wiki\/Escala_Likert."},{"key":"ref_23","unstructured":"Bastos, R.S. (2014). Development of a Web-Based Periscope Simulator for Submarine Officer Training, Naval Postgraduate School."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7624\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:31:22Z","timestamp":1760167882000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7624"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,17]]},"references-count":23,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21227624"],"URL":"https:\/\/doi.org\/10.3390\/s21227624","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,11,17]]}}}