{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T20:59:53Z","timestamp":1781816393321,"version":"3.54.5"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,11,12]],"date-time":"2021-11-12T00:00:00Z","timestamp":1636675200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Project","award":["2020YFB2103900-3"],"award-info":[{"award-number":["2020YFB2103900-3"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61973235"],"award-info":[{"award-number":["61973235"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shanghai Science and Technology Innovation Plan","award":["20510760400"],"award-info":[{"award-number":["20510760400"]}]},{"name":"Shanghai Municipal Science and Technology Major Project","award":["2021SHZDZX0100"],"award-info":[{"award-number":["2021SHZDZX0100"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2021,11,30]]},"abstract":"<jats:p>\n            The panorama stitching system is an indispensable module in surveillance or space exploration. Such a system enables the viewer to understand the surroundings instantly by aligning the surrounding images on a plane and fusing them naturally. The bottleneck of existing systems mainly lies in alignment and naturalness of the transition of adjacent images. When facing dynamic foregrounds, they may produce outputs with misaligned semantic objects, which is evident and sensitive to human perception. We solve three key issues in the existing workflow that can affect its efficiency and the quality of the obtained panoramic video and present Pedestrian360, a panoramic video system based on a structured camera array (a spatial surround-view camera system). First, to get a geometrically aligned 360\u25cb view in the horizontal direction, we build a unified multi-camera coordinate system via a novel refinement approach that jointly optimizes camera poses. Second, to eliminate the brightness and color difference of images taken by different cameras, we design a photometric alignment approach by introducing a bias to the baseline linear adjustment model and solving it with two-step least-squares. Third, considering that the human visual system is more sensitive to high-level semantic objects, such as pedestrians and vehicles, we integrate the results of instance segmentation into the framework of dynamic programming in the seam-cutting step. To our knowledge, we are the first to introduce instance segmentation to the seam-cutting problem, which can ensure the integrity of the salient objects in a panorama. Specifically, in our surveillance oriented system, we choose the most significant target, pedestrians, as the seam avoidance target, and this accounts for the name\n            <jats:italic>Pedestrian360<\/jats:italic>\n            . To validate the effectiveness and efficiency of Pedestrian360, a large-scale dataset composed of videos with pedestrians in five scenes is established. The test results on this dataset demonstrate the superiority of Pedestrian360 compared to its competitors. Experimental results show that Pedestrian360 can stitch videos at a speed of 12 to 26 fps, which depends on the number of objects in the shooting scene and their frequencies of movements. To make our reported results reproducible, the relevant code and collected data are publicly available at\n            <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/cslinzhang.github.io\/Pedestrian360-Homepage\/\">https:\/\/cslinzhang.github.io\/Pedestrian360-Homepage\/<\/jats:ext-link>\n            .\n          <\/jats:p>","DOI":"10.1145\/3460511","type":"journal-article","created":{"date-parts":[[2021,11,12]],"date-time":"2021-11-12T21:16:06Z","timestamp":1636751766000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Pedestrian-Aware Panoramic Video Stitching Based on a Structured Camera Array"],"prefix":"10.1145","volume":"17","author":[{"given":"Anqi","family":"Zhu","sequence":"first","affiliation":[{"name":"School of Software Engineering, Tongji University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Tongji University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juntao","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Tongji University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yicong","family":"Zhou","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Science, University of Macau, Macau, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,11,12]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2644615"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9091336"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.5555\/946247.946772"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-0002-3"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3476247"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_12"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.3390\/s18092956"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383296"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2018.2859746"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995433"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2017.2750087"},{"key":"e_1_3_1_13_2","first-page":"SPIE, 829007","volume-title":"Three-Dimensional Image Processing and Applications II","author":"Han Seung-Ryong","year":"2012","unstructured":"Seung-Ryong Han, Jongsul Min, Taesung Park, and Yongje Kim. 2012. Photometric and geometric rectification for stereoscopic images. In Three-Dimensional Image Processing and Applications II, Vol. 8290. SPIE, 829007."},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.3390\/s16010007"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.322"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.3182\/20120905-3-HR-2030.00193"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6907579"},{"key":"e_1_3_1_18_2","first-page":"1793","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Heng Lionel","year":"2013","unstructured":"Lionel Heng, Bo Li, and Marc Pollefeys. 2013. Camodocal: Automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry. In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems. 1793\u20131800."},{"key":"e_1_3_1_19_2","first-page":"1","volume-title":"Proceedings of the IEEE International Conference on Multimedia and Expo","author":"Hu Jie","year":"2015","unstructured":"Jie Hu, Dong-Qing Zhang, Heather Yu, and Chang Wen Chen. 2015. Discontinuous seam cutting for enhanced video stitching. In Proceedings of the IEEE International Conference on Multimedia and Expo. 1\u20136."},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.271"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.248"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2953705"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.3390\/s19235310"},{"key":"e_1_3_1_24_2","first-page":"3607","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation","author":"K\u00fcmmerle Rainer","year":"2011","unstructured":"Rainer K\u00fcmmerle, Giorgio Grisetti, Hauke Strasdat, Kurt Konolige, and Wolfram Burgard. 2011. G2o: A general framework for graph optimization. In Proceedings of the IEEE International Conference on Robotics and Automation. 3607\u20133613."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882264"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925983"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.579"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/CAC.2018.8623120"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2019.2953950"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11760-018-1241-9"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11760-019-01466-9"},{"key":"e_1_3_1_32_2","first-page":"724","volume-title":"IEEE Transactions on Image Processing","volume":"29","author":"Liao Tianli","year":"2019","unstructured":"Tianli Liao and Nan Li. 2019. Single-perspective warps in natural image stitching. IEEE Transactions on Image Processing 29 (2019), 724\u2013735."},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995314"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/WCSP.2011.6096963"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-6337-2"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2836313"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.70"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/IVS.2017.7995702"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553479"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.5555\/2969239.2969250"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.5555\/2969033.2969100"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.606"},{"key":"e_1_3_1_44_2","doi-asserted-by":"crossref","first-page":"SPIE, 60690G","DOI":"10.1117\/12.640261","volume-title":"Digital Photography II","author":"Suen Simon T. Y.","year":"2006","unstructured":"Simon T. Y. Suen, Edmund Y. Lam, and Kenneth K. Y. Wong. 2006. Digital photograph stitching with optimized matching of gradient and curvature. In Digital Photography II, Vol. 6069. SPIE, 60690G."},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISM.2013.21"},{"key":"e_1_3_1_46_2","first-page":"4","article-title":"Calibration of multi-camera systems using planar patterns","volume":"8","author":"Ueshiba Toshio","year":"2002","unstructured":"Toshio Ueshiba and Fumiaki Tomita. 2002. Calibration of multi-camera systems using planar patterns. Sensors 8 (2002), 4.","journal-title":"Sensors"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2001.991005"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298938"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33712-3_3"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2013.2290576"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.247"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2014.103"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2535225"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2019.8803453"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIG.2007.29"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.54"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460511","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3460511","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:55Z","timestamp":1750193275000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460511"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,12]]},"references-count":56,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,11,30]]}},"alternative-id":["10.1145\/3460511"],"URL":"https:\/\/doi.org\/10.1145\/3460511","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,12]]},"assertion":[{"value":"2020-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}