{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T13:33:30Z","timestamp":1765546410649,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,11,14]],"date-time":"2018-11-14T00:00:00Z","timestamp":1542153600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001602","name":"Science Foundation Ireland","doi-asserted-by":"publisher","award":["SFI\/12\/RC\/2302","SFI\/14\/SP\/2740"],"award-info":[{"award-number":["SFI\/12\/RC\/2302","SFI\/14\/SP\/2740"]}],"id":[{"id":"10.13039\/501100001602","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Many current and future applications of underwater robotics require real-time sensing and interpretation of the environment. As the vast majority of robots are equipped with cameras, computer vision is playing an increasingly important role it this field. This paper presents the implementation and experimental results of underwater StereoFusion, an algorithm for real-time 3D dense reconstruction and camera tracking. Unlike KinectFusion on which it is based, StereoFusion relies on a stereo camera as its main sensor. The algorithm uses the depth map obtained from the stereo camera to incrementally build a volumetric 3D model of the environment, while simultaneously using the model for camera tracking. It has been successfully tested both in a lake and in the ocean, using two different state-of-the-art underwater Remotely Operated Vehicles (ROVs). Ongoing work focuses on applying the same algorithm to acoustic sensors, and on the implementation of a vision based monocular system with the same capabilities.<\/jats:p>","DOI":"10.3390\/s18113936","type":"journal-article","created":{"date-parts":[[2018,11,14]],"date-time":"2018-11-14T10:58:22Z","timestamp":1542193102000},"page":"3936","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Real-Time Underwater StereoFusion"],"prefix":"10.3390","volume":"18","author":[{"given":"Matija","family":"Rossi","sequence":"first","affiliation":[{"name":"Centre for Robotics &amp; Intelligent Systems, University of Limerick, Limerick V94 T9PX, Ireland"}]},{"given":"Petar","family":"Trsli\u0107","sequence":"additional","affiliation":[{"name":"Centre for Robotics &amp; Intelligent Systems, University of Limerick, Limerick V94 T9PX, Ireland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5027-9300","authenticated-orcid":false,"given":"Satja","family":"Siv\u010dev","sequence":"additional","affiliation":[{"name":"Centre for Robotics &amp; Intelligent Systems, University of Limerick, Limerick V94 T9PX, Ireland"}]},{"given":"James","family":"Riordan","sequence":"additional","affiliation":[{"name":"School of Computing, Engineering, and Physical Sciences, University of the West of Scotland, Glasgow G72 0AG, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3601-9216","authenticated-orcid":false,"given":"Daniel","family":"Toal","sequence":"additional","affiliation":[{"name":"Centre for Robotics &amp; Intelligent Systems, University of Limerick, Limerick V94 T9PX, Ireland"}]},{"given":"Gerard","family":"Dooly","sequence":"additional","affiliation":[{"name":"Centre for Robotics &amp; Intelligent Systems, University of Limerick, Limerick V94 T9PX, Ireland"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/MCG.2010.20","article-title":"We All Live in a Virtual Submarine","volume":"30","author":"Chapman","year":"2010","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/S0022-0981(03)00369-1","article-title":"3-D reconstruction of biological objects using underwater video technique and image processing","volume":"297","author":"Cocito","year":"2003","journal-title":"J. Exp. Mar. Biol. Ecol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1109\/JOE.2005.851391","article-title":"An ROV Stereovision System for Ship-Hull Inspection","volume":"31","author":"Negahdaripour","year":"2006","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ledezma, F.D., Amer, A., Abdellatif, F., Outa, A., Trigui, H., Patel, S., and Binyahib, R. (2015). A Market Survey of Offshore Underwater Robotic Inspection Technologies for the Oil and Gas Industry. Soc. Pet. Eng.","DOI":"10.2118\/177989-MS"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Antonelli, G. (2014). Underwater Robots, Springer. Springer Tracts in Advanced Robotics.","DOI":"10.1007\/978-3-319-02877-4"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Elvander, J., and Hawkes, G. (2012, January 14\u201319). ROVs and AUVs in support of marine renewable technologies. Proceedings of the 2012 Oceans, Hampton Roads, VA, USA.","DOI":"10.1109\/OCEANS.2012.6405139"},{"key":"ref_7","first-page":"740","article-title":"A Low Cost Autonomous Underwater Vehicle for Patrolling and Monitoring","volume":"231","author":"Allotta","year":"2017","journal-title":"Proc. Inst. Mech. Eng. Part M J. Eng. Marit. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1007\/s11554-014-0416-z","article-title":"A Survey on Real-Time Motion Estimation Techniques for Underwater Robots","volume":"11","author":"Ferreira","year":"2016","journal-title":"J. Real-Time Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.conengprac.2018.03.005","article-title":"Fully Automatic Visual Servoing Control for Work-Class Marine Intervention ROVs","volume":"74","author":"Rossi","year":"2018","journal-title":"Control Eng. Pract."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Siv\u010dev, S., Coleman, J., Adley, D., Dooly, G., Omerdi\u0107, E., and Toal, D. (2015, January 19\u201322). Closing the Gap between Industrial Robots and Underwater Manipulators. Proceedings of the OCEANS 2015-MTS\/IEEE Washington, Washington, DC, USA.","DOI":"10.23919\/OCEANS.2015.7404563"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Cieslak, P., Ridao, P., and Giergiel, M. (2015, January 26\u201330). Autonomous underwater panel operation by GIRONA500 UVMS: A practical approach to autonomous underwater manipulation. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139230"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ribas, D., Ridao, P., Turetta, A., Melchiorri, C., Palli, G., Fernandez, J., and Sanz, P. (2015). I-AUV Mechatronics Integration for the TRIDENT FP7 Project. IEEE\/ASME Trans. Mechatron.","DOI":"10.1109\/TMECH.2015.2395413"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Omerdic, E., and Toal, D. (2012, January 3\u20136). OceanRINGS: System concept & applications. Proceedings of the 2012 20th Mediterranean Conference on Control Automation (MED), Barcelona, Spain.","DOI":"10.1109\/MED.2012.6265833"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Rossi, M., Scaradozzi, D., Drap, P., Recanatini, P., Dooly, G., Omerdi\u0107, E., and Toal, D. (2015, January 19\u201322). Real-Time Reconstruction of Underwater Environments: From 2D to 3D. Proceedings of the OCEANS 2015-MTS\/IEEE Washington, Washington, DC, USA.","DOI":"10.23919\/OCEANS.2015.7404506"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., and Fitzgibbon, A. (2011, January 26\u201329). KinectFusion: Real-Time Dense Surface Mapping and Tracking. Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., and Davison, A. (2011, January 16\u201319). KinectFusion: Real-Time 3D Reconstruction and Interaction Using a Moving Depth Camera. Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST \u201911), Santa Barbara, CA, USA.","DOI":"10.1145\/2047196.2047270"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_18","unstructured":"Thrun, S. (2002). Robotic Mapping: A Survey. Exploring Artificial Intelligence in the New Millenium, Morgan Kaufmann."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1403","DOI":"10.1109\/ICCV.2003.1238654","article-title":"Real-Time Simultaneous Localisation and Mapping with a Single Camera","volume":"Volume 2","author":"Davison","year":"2003","journal-title":"Proceedings of the Ninth IEEE International Conference on Computer Vision (ICCV \u201903)"},{"key":"ref_20","unstructured":"Nister, D., Naroditsky, O., and Bergen, J. (July, January 27). Visual Odometry. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), Washington, DC, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Fossen, T.I., Pettersen, K.Y., and Nijmeijer, H. (2017). Pose-Graph SLAM for Underwater Navigation. Sensing and Control for Autonomous Vehicles: Applications to Land, Water and Air Vehicles, Springer International Publishing. Lecture Notes in Control and Information Sciences.","DOI":"10.1007\/978-3-319-55372-6"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bonin-Font, F., Cosic, A., Negre, P.L., Solbach, M., and Oliver, G. (2015, January 18\u201321). Stereo SLAM for Robust Dense 3D Reconstruction of Underwater Environments. Proceedings of the OCEANS 2015-Genova, Genoa, Italy.","DOI":"10.1109\/OCEANS-Genova.2015.7271333"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Klein, G., and Murray, D. (2007, January 13\u201316). Parallel Tracking and Mapping for Small AR Workspaces. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR \u201907), Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1007\/s10851-010-0251-1","article-title":"A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging","volume":"40","author":"Chambolle","year":"2010","journal-title":"J. Math. Imag. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., and Davison, A.J. (2010, January 13\u201318). Live Dense Reconstruction with a Single Moving Camera. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539794"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Graber, G., Pock, T., and Bischof, H. (2011, January 6\u201313). Online 3D Reconstruction Using Convex Optimization. Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130318"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Lovegrove, S., and Davison, A. (2011, January 6\u201313). DTAM: Dense Tracking and Mapping in Real-Time. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126513"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"15960","DOI":"10.1109\/ACCESS.2017.2733003","article-title":"Underwater 3-D Scene Reconstruction Using Kinect v2 Based on Physical Models for Refraction and Time of Flight Correction","volume":"5","author":"Anwer","year":"2017","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"7115","DOI":"10.1109\/ACCESS.2017.2690455","article-title":"Depth Map Reconstruction for Underwater Kinect Camera Using Inpainting and Local Image Mode Filtering","volume":"5","author":"Lu","year":"2017","journal-title":"IEEE Access"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yilmaz, O., and Karakus, F. (2013, January 7\u20139). Stereo and Kinect Fusion for Continuous 3D Reconstruction and Visual Odometry. Proceedings of the 2013 International Conference on Electronics, Computer and Computation (ICECCO), Ankara, Turkey.","DOI":"10.1109\/ICECCO.2013.6718242"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hogue, A., German, A., and Jenkin, M. (2007, January 7\u201310). Underwater Environment Reconstruction Using Stereo and Inertial Data. Proceedings of the 2007 IEEE International Conference on Systems, Man and Cybernetics, Montreal, QC, Canada.","DOI":"10.1109\/ICSMC.2007.4413666"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Servos, J., Smart, M., and Waslander, S.L. (2013, January 3\u20137). Underwater Stereo SLAM with Refraction Correction. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696833"},{"key":"ref_33","unstructured":"Wu, Y., Nian, R., and He, B. (2013, January 23\u201327). 3D Reconstruction Model of Underwater Environment in Stereo Vision System. Proceedings of the 2013 OCEANS-San Diego, San Diego, CA, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hurt\u00f3s, N., Nagappa, S., Palomeras, N., and Salvi, J. (June, January 31). Real-Time Mosaicing with Two-Dimensional Forward-Looking Sonar. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906916"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Li, H., Dong, Y., He, X., Xie, S., and Luo, J. (2014, January 3\u20136). A Sonar Image Mosaicing Algorithm Based on Improved SIFT for USV. Proceedings of the 2014 IEEE International Conference on Mechatronics and Automation, Tianjin, China.","DOI":"10.1109\/ICMA.2014.6885981"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lagudi, A., Bianco, G., Muzzupappa, M., and Bruno, F. (2016). An Alignment Method for the Integration of Underwater 3D Data Captured by a Stereovision System and an Acoustic Camera. Sensors, 16.","DOI":"10.3390\/s16040536"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Digumarti, S.T., Chaurasia, G., Taneja, A., Siegwart, R., Thomas, A., and Beardsley, P. (2016, January 7\u201310). Underwater 3D Capture Using a Low-Cost Commercial Depth Camera. Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477644"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Dancu, A., Fourgeaud, M., Franjcic, Z., and Avetisyan, R. (2014, January 3\u20136). Underwater Reconstruction Using Depth Sensors. Proceedings of the SIGGRAPH Asia 2014 Technical Briefs (SA \u201914), Shenzhen, China.","DOI":"10.1145\/2669024.2669042"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1007\/s001380050120","article-title":"A Compact Algorithm for Rectification of Stereo Pairs","volume":"12","author":"Fusiello","year":"2000","journal-title":"Mach. Vis. Appl."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/TPAMI.2003.1217603","article-title":"Advances in Computational Stereo","volume":"25","author":"Brown","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Curless, B., and Levoy, M. (1996, January 4\u20139). A Volumetric Method for Building Complex Models from Range Images. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA.","DOI":"10.1145\/237170.237269"},{"key":"ref_42","unstructured":"Rusinkiewicz, S., and Levoy, M. (June, January 28). Efficient Variants of the ICP Algorithm. Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, QC, Canada."},{"key":"ref_43","unstructured":"Chen, Y., and Medioni, G. (1991, January 9\u201311). Object Modeling by Registration of Multiple Range Images. Proceedings of the 1991 IEEE International Conference on Robotics and Automation, Sacramento, CA, USA."},{"key":"ref_44","unstructured":"Low, K.L. (2004). Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration, University of North Carolina at Chapel Hill. Technical Report."},{"key":"ref_45","unstructured":"Prisacariu, V.A., K\u00e4hler, O., Cheng, M.M., Ren, C.Y., Valentin, J., Torr, P.H.S., Reid, I.D., and Murray, D.W. (2014). A Framework for the Volumetric Integration of Depth Images. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1137\/0111030","article-title":"An Algorithm for Least-Squares Estimation of Nonlinear Parameters","volume":"11","author":"Marquardt","year":"1963","journal-title":"J. Soc. Ind. Appl. Math."},{"key":"ref_47","unstructured":"Parker, S., Shirley, P., Livnat, Y., Hansen, C., and Sloan, P. (1998, January 18\u201323). Interactive Ray Tracing for Isosurface Rendering. Proceedings of the Visualization \u201998, Research Triangle Park, NC, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.1109\/TVCG.2015.2459891","article-title":"Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices","volume":"21","author":"Prisacariu","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_49","unstructured":"Ravi (2018, October 07). Fork of the Voxel Hashing Based Volumetric Integration of Depth Images, InfiniTAM, That Enables ROS as an Input Source. Available online: https:\/\/github.com\/ravich2-7183\/InfiniTAM."},{"key":"ref_50","unstructured":"(2018, May 22). Technical Application Notes. Available online: https:\/\/www.ptgrey.com\/tan\/11052."},{"key":"ref_51","first-page":"444","article-title":"Decentering Distortion of Lenses","volume":"32","author":"Brown","year":"1966","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_52","unstructured":"(2018, October 26). Agisoft PhotoScan. Available online: http:\/\/www.agisoft.com\/."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Pradeep, V., Rhemann, C., Izadi, S., Zach, C., Bleyer, M., and Bathiche, S. (2013, January 1\u20134). MonoFusion: Real-Time 3D Reconstruction of Small Scenes with a Single Web Camera. Proceedings of the 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Adelaide, Australia.","DOI":"10.1109\/ISMAR.2013.6671767"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/11\/3936\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:29:39Z","timestamp":1760196579000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/11\/3936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,14]]},"references-count":53,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["s18113936"],"URL":"https:\/\/doi.org\/10.3390\/s18113936","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,11,14]]}}}