{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T01:40:57Z","timestamp":1768009257423,"version":"3.49.0"},"reference-count":55,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2016,12,22]],"date-time":"2016-12-22T00:00:00Z","timestamp":1482364800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. 41571436"],"award-info":[{"award-number":["No. 41571436"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. 41271431"],"award-info":[{"award-number":["No. 41271431"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Hubei Province Science and Technology Support Program, China","award":["No. 2015BAA027"],"award-info":[{"award-number":["No. 2015BAA027"]}]},{"name":"the Jiangsu Province Science and Technology Support Program, China","award":["No. BE2014866"],"award-info":[{"award-number":["No. BE2014866"]}]},{"name":"LIESMARS Special Research Funding"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we propose a unified framework to generate a pleasant and high-quality street-view panorama by stitching multiple panoramic images captured from the cameras mounted on the mobile platform. Our proposed framework is comprised of four major steps: image warping, color correction, optimal seam line detection and image blending. Since the input images are captured without a precisely common projection center from the scenes with the depth differences with respect to the cameras to different extents, such images cannot be precisely aligned in geometry. Therefore, an efficient image warping method based on the dense optical flow field is proposed to greatly suppress the influence of large geometric misalignment at first. Then, to lessen the influence of photometric inconsistencies caused by the illumination variations and different exposure settings, we propose an efficient color correction algorithm via matching extreme points of histograms to greatly decrease color differences between warped images. After that, the optimal seam lines between adjacent input images are detected via the graph cut energy minimization framework. At last, the Laplacian pyramid blending algorithm is applied to further eliminate the stitching artifacts along the optimal seam lines. Experimental results on a large set of challenging street-view panoramic images captured form the real world illustrate that the proposed system is capable of creating high-quality panoramas.<\/jats:p>","DOI":"10.3390\/s17010001","type":"journal-article","created":{"date-parts":[[2016,12,22]],"date-time":"2016-12-22T09:48:53Z","timestamp":1482400133000},"page":"1","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":88,"title":["A Unified Framework for Street-View Panorama Stitching"],"prefix":"10.3390","volume":"17","author":[{"given":"Li","family":"Li","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Yao","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Renping","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Menghan","family":"Xia","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Control Science and Engineering, Shandong University, Jinan 250061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,12,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"169","DOI":"10.14358\/PERS.74.2.169","article-title":"Automatic registration and mosaicking for airborne multispectral image sequences","volume":"74","author":"Du","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.isprsjprs.2009.09.001","article-title":"Seam-line determination for image mosaicking: A technique minimizing the maximum local mismatch and the global cost","volume":"65","author":"Chon","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2012.11.002","article-title":"Automatic determination of seamlines for aerial image mosaicking based on vector roads alone","volume":"76","author":"Wan","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1109\/LGRS.2013.2293197","article-title":"Seamline Determination Based on Segmentation for Urban Image Mosaicking","volume":"11","author":"Pan","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2015.11.007","article-title":"SGM-based seamline determination for urban orthophoto mosaicking","volume":"112","author":"Pang","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/S0924-2716(01)00033-8","article-title":"Seamline detection in colour orthoimage mosaicking by use of twin snakes","volume":"56","author":"Kerschner","year":"2001","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1109\/TPAMI.2006.99","article-title":"Morphological image compositing","volume":"28","author":"Soille","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yang, Y., Gao, Y., Li, H., and Han, Y. (2011, January 9\u201311). An algorithm for remote sensing image mosaic based on valid area. Proceedings of the International Symposium on Image and Data Fusion (ISIDF), Tengchong, China.","DOI":"10.1109\/ISIDF.2011.6024278"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.isprsjprs.2015.09.009","article-title":"A robust mosaicking procedure for high spatial resolution remote sensing images","volume":"109","author":"Li","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1145\/1015706.1015718","article-title":"Interactive Digital Photomontage","volume":"23","author":"Agarwala","year":"2004","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_11","first-page":"1","article-title":"Image alignment and stitching: A tutorial","volume":"2","author":"Szeliski","year":"2006","journal-title":"Found. Trends\u00ae Comput. Graph. Vis."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic panoramic image stitching using invariant features","volume":"74","author":"Brown","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1016\/j.imavis.2008.04.014","article-title":"Fast image blending using watersheds and graph cuts","volume":"27","author":"Gracias","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/JOE.2012.2204152","article-title":"A novel blending technique for underwater gigamosaicing","volume":"37","author":"Prados","year":"2012","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1109\/TVCG.2014.2366128","article-title":"Distributed Seams for Gigapixel Panoramas","volume":"21","author":"Philip","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1145\/882262.882264","article-title":"Graphcut Textures Image and Video Synthesis Using Graph Cuts","volume":"22","author":"Kwatra","year":"2003","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1000","DOI":"10.1080\/01431161.2010.545083","article-title":"Towards the automatic selection of optimal seam line locations when merging optical remote-sensing images","volume":"33","author":"Yu","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.isprsjprs.2012.11.003","article-title":"Global seamline networks for orthomosaic generation via local search","volume":"75","author":"Mills","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2015.12.007","article-title":"Optimal seamline detection for multiple image mosaicking via graph cuts","volume":"113","author":"Li","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/BF00133570","article-title":"Snakes: Active contour models","volume":"1","author":"Kass","year":"1988","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/BF01386390","article-title":"A note on two problems in connexion with graphs","volume":"1","author":"Dijkstra","year":"1959","journal-title":"Numerische Mathematik"},{"key":"ref_22","unstructured":"Bellman, R. (1957). Dynamic Programming, Princeton University Press."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1222","DOI":"10.1109\/34.969114","article-title":"Fast approximate energy minimization via graph cuts","volume":"23","author":"Boykov","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1080\/02664769823151","article-title":"A review of image-warping methods","volume":"25","author":"Glasbey","year":"1998","journal-title":"J. Appl. Stat."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/(SICI)1099-1778(199601)7:1<3::AID-VIS131>3.0.CO;2-U","article-title":"Image morphing using deformation techniques","volume":"7","author":"Lee","year":"1996","journal-title":"J. Vis. Comput. Animat."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2629494","article-title":"Automating image morphing using structural similarity on a halfway domain","volume":"33","author":"Liao","year":"2014","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, F., and Gleicher, M. (2005, January 23\u201326). Automatic image retargeting with fisheye-view warping. Proceedings of the ACM Symposium on User Interface Software and Technology, Seattle, WA, USA.","DOI":"10.1145\/1095034.1095061"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1109\/TMM.2012.2228475","article-title":"Patch-based image warping for content-aware retargeting","volume":"15","author":"Lin","year":"2013","journal-title":"IEEE Trans. Multimed."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zaragoza, J., Chin, T.J., Brown, M., and Suter, D. (2013, January 23\u201328). As-projective-as-possible image stitching with moving DLT. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.303"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lin, C.C., Pankanti, S.U., Ramamurthy, K.N., and Aravkin, A.Y. (2015, January 7\u201312). Adaptive as-natural-as-possible image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298719"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1109\/34.24792","article-title":"Principal warps: Thin-plate splines and the decomposition of deformations","volume":"11","author":"Bookstein","year":"1989","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Alexa, M., Cohen-Or, D., and Levin, D. (2000, January 23\u201328). As-Rigid-As-Possible Shape Interpolation. Proceedings of the Internationl Conference on Computer Graphics and Interactive Techniques Conference (SIGGRAPH), New Orleans, LA, USA.","DOI":"10.1145\/344779.344859"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1145\/1073204.1073323","article-title":"As-rigid-as-possible shape manipulation","volume":"24","author":"Igarashi","year":"2005","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1145\/1141911.1141920","article-title":"Image deformation using moving least squares","volume":"25","author":"Schaefer","year":"2006","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1090\/S0025-5718-98-00974-0","article-title":"The approximation power of moving least-squares","volume":"67","author":"Levin","year":"1998","journal-title":"Math. Comput. Am. Math. Soc."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1080\/02664763.2013.838667","article-title":"Image warping using radial basis functions","volume":"41","author":"Chen","year":"2014","journal-title":"J. Appl. Stat."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/2945.620490","article-title":"Scattered data interpolation with multilevel B-splines","volume":"3","author":"Lee","year":"1997","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_38","unstructured":"Yao, J. (2006). Modeling and Rendering from Multiple Views. [Ph.D. Thesis, The Chinse University of Hong Kong]."},{"key":"ref_39","first-page":"506","article-title":"3D modeling and rendering from multiple wide-baseline images by match propagation","volume":"21","author":"Yao","year":"2006","journal-title":"Signal Process.: Image Commun."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Xu, W., and Mulligan, J. (2010, January 13\u201318). Performance evaluation of color correction approaches for automatic multi-view image and video stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540202"},{"key":"ref_41","unstructured":"Tian, G.Y., Gledhill, D., Taylor, D., and Clarke, D. (2002, January 10\u201312). Colour correction for panoramic imaging. Proceedings of the International Conference on Information Visualisation, London, UK."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1109\/TCE.2010.5505931","article-title":"Fast panorama stitching for high-quality panoramic images on mobile phones","volume":"56","author":"Xiong","year":"2010","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hwang, Y., Lee, J.Y., Kweon, I.S., and Kim, S.J. (2014, January 23\u201328). Color transfer using probabilistic moving least squares. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.427"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1007\/s11633-008-0234-5","article-title":"Color correction for multi-view video using energy minimization of view networks","volume":"5","author":"Yamamoto","year":"2008","journal-title":"Int. J. Autom. Comput."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1258","DOI":"10.1109\/TCSVT.2008.926997","article-title":"Histogram-based prefiltering for luminance and chrominance compensation of multiview video","volume":"18","author":"Fecker","year":"2008","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_47","unstructured":"Uyttendaele, M., Eden, A., and Skeliski, R. (2001, January 8\u201314). Eliminating ghosting and exposure artifacts in image mosaics. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Kauai, HI, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1145\/964965.808606","article-title":"Compositing Digital Images","volume":"18","author":"Porter","year":"1984","journal-title":"ACM SIGGRAPH Comput. Graph."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1145\/245.247","article-title":"A multiresolution spline with application to image mosaics","volume":"2","author":"Burt","year":"1983","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1145\/882262.882269","article-title":"Poisson image editing","volume":"22","author":"Gangnet","year":"2003","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Levin, A., Zomet, A., Peleg, S., and Weiss, Y. (2004, January 11\u201314). Seamless image stitching in the gradient domain. Proceedings of the European Conference on Computer Vision (ECCV), Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24673-2_31"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"3081","DOI":"10.1016\/j.patcog.2007.02.011","article-title":"Robust multi-view feature matching from multiple unordered views","volume":"40","author":"Yao","year":"2007","journal-title":"Pattern Recognit."},{"key":"ref_53","first-page":"404","article-title":"SURF: Speeded up Robust Features","volume":"110","author":"Bay","year":"2006","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"38:1","DOI":"10.1145\/2461912.2461997","article-title":"Optimizing color consistency in photo collections","volume":"32","author":"HaCohen","year":"2013","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_55","first-page":"1","article-title":"Blind image quality assessment by relative gradient statistics and adaboosting neural network","volume":"40","author":"Liu","year":"2015","journal-title":"Signal Process.: Image Commun."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/1\/1\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:29:03Z","timestamp":1760210943000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/1\/1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,12,22]]},"references-count":55,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,1]]}},"alternative-id":["s17010001"],"URL":"https:\/\/doi.org\/10.3390\/s17010001","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,12,22]]}}}