{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T03:05:23Z","timestamp":1740107123633,"version":"3.37.3"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2022,7,9]],"date-time":"2022-07-09T00:00:00Z","timestamp":1657324800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,9]],"date-time":"2022-07-09T00:00:00Z","timestamp":1657324800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000811","name":"European Institute of Innovation and Technology","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000811","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis Comput"],"published-print":{"date-parts":[[2023,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Nowadays the trend is to acquire and share information in an immersive and natural way with new technologies such as Virtual Reality (VR) and 360<jats:inline-formula><jats:alternatives><jats:tex-math>$$^{\\circ }$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:msup><mml:mrow\/><mml:mo>\u2218<\/mml:mo><\/mml:msup><\/mml:math><\/jats:alternatives><\/jats:inline-formula>video. However, the use of 360<jats:inline-formula><jats:alternatives><jats:tex-math>$$^{\\circ }$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:msup><mml:mrow\/><mml:mo>\u2218<\/mml:mo><\/mml:msup><\/mml:math><\/jats:alternatives><\/jats:inline-formula>video, even more the use of VR head-mounted display, can generate general discomfort (\u201ccybersickness\u201d) and one factor is the video shaking. In this work, we developed a method to make the viewing of 360<jats:inline-formula><jats:alternatives><jats:tex-math>$$^{\\circ }$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:msup><mml:mrow\/><mml:mo>\u2218<\/mml:mo><\/mml:msup><\/mml:math><\/jats:alternatives><\/jats:inline-formula>video smoother and more comfortable to watch. First, the rotations are obtained with an innovative technique using a Particle Swarm Optimization algorithm considering the uncertainty estimation among features. In addition, a modified Chauvenet criterion is used to find and suppress outliers features from the algorithm. Afterward, a time-weighted color filter is applied to each frame in order to handle also videos with small translational jitter, rolling shutter wobble, parallax, and lens deformation. Thanks to our complete offline stabilization process, we achieved good-quality results in terms of video stabilization. Achieving better robustness compared to other works. The method was validated using virtual and real 360<jats:inline-formula><jats:alternatives><jats:tex-math>$$^{\\circ }$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:msup><mml:mrow\/><mml:mo>\u2218<\/mml:mo><\/mml:msup><\/mml:math><\/jats:alternatives><\/jats:inline-formula>video data of a mine environment acquired by a drone. Finally, a user study based on a subjective and standard Simulator Sickness Questionnaire was submitted to quantify simulator sickness before and after the stabilization process. The questionnaire underlined alleviation of cybersickness using stabilized videos with our approach<\/jats:p>","DOI":"10.1007\/s00371-022-02578-z","type":"journal-article","created":{"date-parts":[[2022,7,9]],"date-time":"2022-07-09T13:02:42Z","timestamp":1657371762000},"page":"4103-4116","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Stabilization of spherical videos based on feature uncertainty"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0960-0996","authenticated-orcid":false,"given":"A.","family":"Luchetti","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8813-215X","authenticated-orcid":false,"given":"M.","family":"Zanetti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Kalkofen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1562-0328","authenticated-orcid":false,"given":"M.","family":"De Cecco","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,7,9]]},"reference":[{"key":"2578_CR1","first-page":"1321","volume":"77","author":"Paul Milgram","year":"1994","unstructured":"Milgram, Paul, Kishino, Fumio: A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77, 1321\u20131329 (1994)","journal-title":"IEICE TRANSACTIONS on Information and Systems"},{"key":"2578_CR2","unstructured":"Bell, J.T., Fogler, H.S.: The investigation and application of virtual reality as an educational tool, In: Proceedings of the American Society for Engineering Education Annual Conference, pp. 1718\u20131728 (1995)"},{"key":"2578_CR3","doi-asserted-by":"crossref","unstructured":"Luchetti, A., Tomasin, P., Fornaser, A., Tallarico, P., Bosetti, P., De Cecco, M.: The human being at the center of smart factories thanks to augmented reality, In: 2019 IEEE 5th International Forum on Research and Technology for Society and Industry (RTSI), pp. 51\u201356 (2019)","DOI":"10.1109\/RTSI.2019.8895555"},{"key":"2578_CR4","doi-asserted-by":"crossref","unstructured":"Butaslac, I.III., Luchetti, A., Parolin, E., Fujimoto, Y., Kanbara, M., De Cecco, M., Kato, H.: The feasibility of augmented reality as a support tool for motor rehabilitation, In: International Conference on AugmentedReality, Virtual Reality and Computer Graphics, pp. 165\u2013173, Springer (2020)","DOI":"10.1007\/978-3-030-58468-9_13"},{"key":"2578_CR5","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/j.ijhcs.2018.02.003","volume":"114","author":"GE Raptis","year":"2018","unstructured":"Raptis, G.E., Fidas, C., Avouris, N.: Effects of mixed-reality on players behaviour and immersion in a cultural tourism game: A cognitive processing perspective. International Journal of Human-Computer Studies 114, 69\u201379 (2018)","journal-title":"International Journal of Human-Computer Studies"},{"key":"2578_CR6","doi-asserted-by":"publisher","first-page":"243","DOI":"10.30958\/ajspo.4.4.1","volume":"4","author":"Andreas Hebbel-Seeger","year":"2017","unstructured":"Hebbel-Seeger, Andreas: 360 degrees video and VR for training and marketing within sports. Athens Journal of Sports 4, 243\u2013261 (2017)","journal-title":"Athens Journal of Sports"},{"key":"2578_CR7","unstructured":"Argyriou, L., Economou, D., Bouki, V.: 360-degree interactive video application for Cultural Heritage Education, In: 3rd Annual International Conference of the Immersive Learning Research Network, Verlag der Technischen Universit\u00e4t Graz (2017)"},{"key":"2578_CR8","doi-asserted-by":"crossref","unstructured":"Guerv\u00f3s, E., Ruiz, J.J., P\u00e9rez, P., Mu\u00f1oz, J.A., D\u00edaz, C., Garc\u00eda, N.: Using 360 VR video to improve the learning experience in veterinary medicine university degree, In: Electronic Imaging, pp. 217\u20131, Society for Imaging Science and Technology (2019)","DOI":"10.2352\/ISSN.2470-1173.2019.12.HVEI-217"},{"key":"2578_CR9","doi-asserted-by":"crossref","unstructured":"Stanney, K.M., Kennedy, R.S., Drexler, J.M.: Cybersickness is not simulator sickness, In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol 41, pp. 1138\u20131142, SAGE Publications Sage CA: Los Angeles, CA (1997)","DOI":"10.1177\/107118139704100292"},{"key":"2578_CR10","doi-asserted-by":"publisher","first-page":"2436","DOI":"10.3389\/fpsyg.2019.02436","volume":"10","author":"S Litleskare","year":"2019","unstructured":"Litleskare, S., Calogiuri, G.: Camera stabilization in 360$$^{\\circ }$$ videos and its impact on cyber sickness, environmental perceptions, and psychophysiological responses to a simulated nature walk: a single-blinded randomized trial. Front. Psychol. 10, 2436 (2019)","journal-title":"Front. Psychol."},{"issue":"11","key":"2578_CR11","doi-asserted-by":"publisher","first-page":"941","DOI":"10.3357\/ASEM.2394.2009","volume":"80","author":"Frederick Bonato","year":"2009","unstructured":"Bonato, Frederick, Bubka, Andrea, Palmisano, Stephen: Combined pitch and roll and cybersickness in a virtual environment. Aviation, Space Environ. Med. 80(11), 941\u2013945 (2009)","journal-title":"Aviation, Space Environ. Med."},{"key":"2578_CR12","doi-asserted-by":"publisher","first-page":"4809","DOI":"10.1016\/j.jfranklin.2018.04.042","volume":"355","author":"Gabriele Perozzi","year":"2018","unstructured":"Perozzi, Gabriele: Efimov, Denis, Biannic, Jean-Marc, Planckaert, Laurent: Trajectory tracking for a quadrotor under wind perturbations: sliding mode control with state-dependent gains. Journal of the Franklin Institute 355, 4809\u20134838 (2018)","journal-title":"Journal of the Franklin Institute"},{"issue":"6","key":"2578_CR13","doi-asserted-by":"publisher","first-page":"1167","DOI":"10.1109\/TRO.2011.2162765","volume":"27","author":"Xuebo Zhang","year":"2011","unstructured":"Zhang, Xuebo, Fang, Yongchun, Liu, Xi.: Motion-estimation-based visual servoing of nonholonomic mobile robots. IEEE Transactions on Robotics 27(6), 1167\u20131175 (2011)","journal-title":"IEEE Transactions on Robotics"},{"key":"2578_CR14","doi-asserted-by":"crossref","unstructured":"Li, S., Wang, F., Shi, T., Kuang, J.: Probably secure multi-user multi-keyword searchable encryption scheme in cloud storage, In: 2019 IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), pp. 1368\u20131372 (2019)","DOI":"10.1109\/ITNEC.2019.8729084"},{"key":"2578_CR15","doi-asserted-by":"crossref","unstructured":"Huang, T.S., Netravali, A.N.: Motion and structure from feature correspondences: A review, In: Advances in Image Processing and Understanding: A Festschrift for Thomas S Huang, pp. 331\u2013347 (2002)","DOI":"10.1142\/9789812776952_0013"},{"issue":"3-4","key":"2578_CR16","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1504\/IJISTA.2010.036578","volume":"9","author":"Nhat-Tan Nguyen","year":"2010","unstructured":"Nguyen, Nhat-Tan., Laurendeau, Denis, Branzan-Albu, Alexandra: A robust method for camera motion estimation in movies based on optical flow. International Journal of Intelligent Systems Technologies and Applications 9(3\u20134), 228\u2013238 (2010)","journal-title":"International Journal of Intelligent Systems Technologies and Applications"},{"issue":"6","key":"2578_CR17","doi-asserted-by":"publisher","first-page":"3581","DOI":"10.1007\/s10489-020-01982-z","volume":"51","author":"Zahra Kamranian","year":"2021","unstructured":"Kamranian, Zahra, Sadeghian, Hamid, Mehrandezh, Ahmad Reza Naghsh Nilchi Mehran.: Fast, yet robust end-to-end camera pose estimation for robotic applications. Applied Intelligence 51(6), 3581\u20133599 (2021)","journal-title":"Applied Intelligence"},{"key":"2578_CR18","unstructured":"Kamali, M., Banno, A., Bazin, J.-C., Kweon, I.S., Ikeuchi, K.: Stabilizing omnidirectional videos using 3d structure and spherical image warping, IAPR MVA, 1, 2, Citeseer (2011)"},{"key":"2578_CR19","first-page":"1","volume":"28","author":"Feng Liu","year":"2009","unstructured":"Liu, Feng, Gleicher, Michael, Jin, Hailin, Agarwala, Aseem: Content-preserving warps for 3D video stabilization. ACM Transactions on Graphics (TOG) 28, 1\u20139 (2009)","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"2578_CR20","doi-asserted-by":"crossref","unstructured":"Buehler, C., Bosse, M., McMillan, L.: Non-metric image-based rendering for video stabilization, In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, 2, II\u2013II (2001)","DOI":"10.1109\/CVPR.2001.991019"},{"key":"2578_CR21","doi-asserted-by":"crossref","unstructured":"Shen, L.-C., Huang, T.-K., Chen, C.-S., Chuang, Y.-Y.: A 2.5 d approach to 360 panorama video stabilization, In: 2018 25th IEEE International Conference on Image Processing (ICIP), pp. 3184\u20133188 (2018)","DOI":"10.1109\/ICIP.2018.8451037"},{"key":"2578_CR22","first-page":"1","volume":"32","author":"Shuaicheng Liu","year":"2013","unstructured":"Liu, Shuaicheng, Yuan, Lu., Tan, Ping, Sun, Jian: Bundled camera paths for video stabilization. ACM Transactions on Graphics (TOG) 32, 1\u201310 (2013)","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"2578_CR23","doi-asserted-by":"publisher","first-page":"922","DOI":"10.1107\/S0567739476001873","volume":"32","author":"W Kabsch","year":"1976","unstructured":"Kabsch, W.: A solution for the best rotation to relate two sets of vectors. Acta. Crystallograph. Sect. A Cryst. Phys. Diffract. Theor. General Crystallograph. 32, 922\u2013923 (1976)","journal-title":"Acta. Crystallograph. Sect. A Cryst. Phys. Diffract. Theor. General Crystallograph."},{"key":"2578_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2980179.2982405","volume":"35","author":"Johannes Kopf","year":"2016","unstructured":"Kopf, Johannes: 360 video stabilization. ACM Transactions on Graphics (TOG) 35, 1\u20139 (2016)","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"2578_CR25","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1145\/358669.358692","volume":"24","author":"MA Fischler","year":"1981","unstructured":"Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381\u2013395 (1981)","journal-title":"Commun. ACM"},{"key":"2578_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3211889","volume":"38","author":"C Tang","year":"2019","unstructured":"Tang, C., Wang, O., Liu, F., Tan, P.: Joint stabilization and direction of 360$$^{\\circ }$$ videos. ACM Trans. Graph. (TOG) 38, 1\u201313 (2019)","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"2578_CR27","doi-asserted-by":"crossref","unstructured":"Kasahara, S., Nagai, S., Rekimoto, J.: First person omnidirectional video: System design and implications for immersive experience, In: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, pp. 33\u201342 (2015)","DOI":"10.1145\/2745197.2745202"},{"key":"2578_CR28","unstructured":"Lai, W.-S., Huang, Y., Joshi, N., Buehler, C., Yang, M.-H., Kang, S.B.: Semantic-driven Generation of Hyperlapse from 360 Video Supplementary Material"},{"key":"2578_CR29","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., Van Gool, L.: Surf: Speeded up robust features, In: European Conference on Computer Vision, pp. 404\u2013417, Springer (2006)","DOI":"10.1007\/11744023_32"},{"key":"2578_CR30","unstructured":"Tomasi, C., Kanade, T.: Detection and Tracking of Point Features. Carnegie Mellon Univ. Pittsburgh, School of Computer Science (1991)"},{"key":"2578_CR31","unstructured":"Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library, O\u2019Reilly Media, Inc. (2008)"},{"key":"2578_CR32","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1021\/ed028p643","volume":"28","author":"WJ Blaedel","year":"1951","unstructured":"Blaedel, W.J., Meloche, V.W., Ramsay, J.A.: A comparison of criteria for the rejection of measurements. J. Chem. Edu. 28, 643 (1951)","journal-title":"J. Chem. Edu."},{"key":"2578_CR33","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1016\/S0020-0190(02)00447-7","volume":"85","author":"IC Trelea","year":"2003","unstructured":"Trelea, I.C.: The particle swarm optimization algorithm: convergence analysis and parameter selection. Inform. Process. Lett. 85, 317\u2013325 (2003)","journal-title":"Inform. Process. Lett."},{"key":"2578_CR34","unstructured":"Google Inc.: Rendering Omni-directional Stereo Content https:\/\/developers.google.com\/vr\/jump\/rendering-ods-content.pdf, [Accessed: 14\/10\/2020]"},{"key":"2578_CR35","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1207\/s15327108ijap0303_3","volume":"3","author":"RS Kennedy","year":"1993","unstructured":"Kennedy, R.S., Lane, N.E., Berbaum, K.S., Lilienthal, M.G.: Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. Int. J. Aviation Psychol. 3, 203\u2013220 (1993)","journal-title":"Int. J. Aviation Psychol."},{"key":"2578_CR36","unstructured":"Walter, H., Li, R., Munafo, J., Curry, C., Peterson, N., Stoffregen, T.: APAL Coupling Study (2019)"}],"container-title":["The Visual Computer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-022-02578-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00371-022-02578-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-022-02578-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,28]],"date-time":"2024-09-28T21:12:52Z","timestamp":1727557972000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00371-022-02578-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,9]]},"references-count":36,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2023,9]]}},"alternative-id":["2578"],"URL":"https:\/\/doi.org\/10.1007\/s00371-022-02578-z","relation":{},"ISSN":["0178-2789","1432-2315"],"issn-type":[{"type":"print","value":"0178-2789"},{"type":"electronic","value":"1432-2315"}],"subject":[],"published":{"date-parts":[[2022,7,9]]},"assertion":[{"value":"6 June 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 July 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare to have no potential conflict of interest. This work was enabled by a research grant of the European Institute of Innovation and Technology (EIT) Raw Materials in the project MiReBooks: Mixed Reality Handbooks for Mining Education (18060).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}