{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T16:05:07Z","timestamp":1777651507730,"version":"3.51.4"},"reference-count":33,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2017,12,26]],"date-time":"2017-12-26T00:00:00Z","timestamp":1514246400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>We propose a novel real-time video stitching method using camera path estimation and homography refinement. The method can stably stitch multiple frames acquired from moving cameras in real time. In the proposed method, one initial between-camera (BC) homography and each camera path (CP) homography are used to estimate the BC homography at every frame. The BC homography is refined by using block matching to adjust the errors of estimated CPs (homography refinement). For fast processing, we extract features using the difference of intensities and use the optical flow to estimate camera motion (CM) homographies, which are multiplied with the previous CMs to calculate CPs (camera path estimations). In experiments, we demonstrated the performance of the CP estimation and homography refinement approach by comparing it with other methods. The experimental results show that the proposed method can stably stitch two image sequences at a rate exceeding 13 fps (frames per second).<\/jats:p>","DOI":"10.3390\/sym10010004","type":"journal-article","created":{"date-parts":[[2017,12,26]],"date-time":"2017-12-26T11:13:23Z","timestamp":1514286803000},"page":"4","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement"],"prefix":"10.3390","volume":"10","author":[{"given":"Jaeyoung","family":"Yoon","sequence":"first","affiliation":[{"name":"Department of Electronics Engineering, Kyung Hee University, Yongin 17104, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daeho","family":"Lee","sequence":"additional","affiliation":[{"name":"Humanitas College, Kyung Hee University, Yongin 17104, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,12,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"He, B., and Yu, S. (2016). Parallax-Robust Surveillance Video Stitching. Sensors, 16.","DOI":"10.3390\/s16010007"},{"key":"ref_2","unstructured":"He, B., Zhao, G., and Liu, Q. (2010, January 8\u20139). Panoramic Video Stitching in Multi-Camera Surveillance System. Proceedings of the 25th International Conference of Image and Vision Computing New Zealand (IVCNZ), Queenstown, New Zealand."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Amiri, A.J., and Moradi, H. (2016, January 26\u201328). Real-Time Video Stabilization and Mosaicking for Monitoring and Surveillance. Proceedings of the 4th International Conference on Robotics and Mechatronics (ICROM), Tehran, Iran.","DOI":"10.1109\/ICRoM.2016.7886813"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2707","DOI":"10.1109\/TCYB.2014.2381774","article-title":"Efficient Video Stitching Based on Fast Structure Deformation","volume":"45","author":"Li","year":"2015","journal-title":"IEEE Trans. Cybern."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1111\/cgf.12848","article-title":"Seamless Video Stitching from Hand-held Camera Inputs","volume":"35","author":"Lin","year":"2016","journal-title":"Comput. Graphics Forum"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5491","DOI":"10.1109\/TIP.2016.2607419","article-title":"Joint Video Stitching and Stabilization from Moving Cameras","volume":"25","author":"Guo","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","first-page":"4","article-title":"Pyramidal Implementation of the Affine Lucas Kanade Feature Tracker Description of the Algorithm","volume":"5","author":"Bouguet","year":"2001","journal-title":"Intel. Corpor."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/0600000009","article-title":"Image Alignment and Stitching: A Tutorial","volume":"Volume 2","author":"Szeliski","year":"2007","journal-title":"Foundations and Trends\u00ae in Computer Graphics and Vision"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006). Surf: Speeded Up Robust Features. Computer Vision\u2013ECCV 2006, Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/11744023_32"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2227","DOI":"10.1109\/TPAMI.2014.2321376","article-title":"Scalable Nearest Neighbor Algorithms for High Dimensional Data","volume":"36","author":"Muja","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun ACM"},{"key":"ref_13","unstructured":"Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. (, January November). Interactive Digital Photomontage. Proceedings of the ACM Transactions on Graphics (TOG), New York, NY, USA."},{"key":"ref_14","unstructured":"Gao, J., Li, Y., Chin, T., and Brown, M.S. (2013). Seam-Driven Image Stitching. Eurographics, The Eurographics Association. Short Papers."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1109\/TIP.2005.863958","article-title":"Seamless Image Stitching by Minimizing False Edges","volume":"15","author":"Zomet","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lee, S., Park, Y., and Lee, D. (2015, January 28\u201330). Seamless Image Stitching using Structure Deformation with HoG Matching. Proceedings of the International Conference on the Information and Communication Technology Convergence (ICTC), Jeju, Korea.","DOI":"10.1109\/ICTC.2015.7354704"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gao, J., Kim, S.J., and Brown, M.S. (2011, January 20\u201325). Constructing Image Panoramas using Dual-Homography Warping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995433"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lin, W., Liu, S., Matsushita, Y., Ng, T., and Cheong, L. (2011, January 20\u201325). Smoothly Varying Affine Stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995314"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zaragoza, J., Chin, T., Brown, M.S., and Suter, D. (2013, January 23\u201328). As-Projective-as-Possible Image Stitching with Moving DLT. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.303"},{"key":"ref_20","unstructured":"Chang, C., Sato, Y., and Chuang, Y. (2004, January 23\u201328). Shape-Preserving Half-Projective Warps for Image Stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA."},{"key":"ref_21","unstructured":"Jiang, W., and Gu, J. (2015, January 7\u201312). Video Stitching with Spatial-Temporal Content-Preserving Warping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Boston, MA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"El-Saban, M., Izz, M., Kaheel, A., and Refaat, M. (2011, January 11\u201314). Improved Optimal Seam Selection Blending for Fast Video Stitching of Videos Captured from Freely Moving Devices. Proceedings of the 18th IEEE International Conference on Image Processing (ICIP), Brussels, Belgium.","DOI":"10.1109\/ICIP.2011.6115723"},{"key":"ref_23","unstructured":"Shimizu, T., Yoneyama, A., and Takishima, Y. (2006, January 7\u201311). A Fast Video Stitching Method for Motion-Compensated Frames in Compressed Video Streams. Proceedings of the 2006 Digest of Technical Papers. International Conference on Consumer Electronics (ICCE\u201906), Las Vegas, NV, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"El-Saban, M., Izz, M., and Kaheel, A. (2010, January 26\u201329). Fast Stitching of Videos Captured from Freely Moving Devices by Exploiting Temporal Redundancy. Proceedings of the 17th IEEE International Conference on Image Processing (ICIP), Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5651811"},{"key":"ref_25","unstructured":"Chen, L., Wang, X., and Liang, X. (2010, January 25\u201327). An Effective Video Stitching Method. Proceedings of the International Conference on Computer Design and Applications (ICCDA), Qinhuangdao, China."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shum, H., and Szeliski, R. (2001). Construction of panoramic image mosaics with global and local alignment. Panoramic Vision, Springer.","DOI":"10.1007\/978-1-4757-3482-9_13"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Szeliski, R., and Shum, H. (1997, January 3\u20138). Creating Full View Panoramic Image Mosaics and Environment Maps. Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA.","DOI":"10.1145\/258734.258861"},{"key":"ref_28","unstructured":"Harris, C., and Stephens, M. (September, January 31). A Combined Corner and Edge Detector. Proceedings of the Alvey Vision Conference, Hong Kong, China."},{"key":"ref_29","unstructured":"(2017, December 26). Original Videos and Results. Available online: http:\/\/sites.google.com\/site\/khuaris\/home\/video-stitching."},{"key":"ref_30","unstructured":"Shi, J. (1994, January 21\u201323). Good Features to Track. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201994), Seattle, WA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1145\/2601097.2601208","article-title":"Videosnapping: Interactive Synchronization of Multiple Videos","volume":"33","author":"Wang","year":"2014","journal-title":"ACM Trans. Graphics (TOG)"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1145\/1531326.1531350","article-title":"Content-Preserving Warps for 3D Video Stabilization","volume":"28","author":"Liu","year":"2009","journal-title":"ACM Trans. Graphics (TOG)"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1117\/12.476436","article-title":"Probabilistic Video Stabilization using Kalman Filtering and Mosaicking","volume":"5022","author":"Litvin","year":"2003","journal-title":"Proc. SPIE"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/1\/4\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:55:39Z","timestamp":1760208939000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/1\/4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,26]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,1]]}},"alternative-id":["sym10010004"],"URL":"https:\/\/doi.org\/10.3390\/sym10010004","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12,26]]}}}