{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:23:36Z","timestamp":1750307016702,"version":"3.41.0"},"reference-count":30,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2012,5,1]],"date-time":"2012-05-01T00:00:00Z","timestamp":1335830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2012,5]]},"abstract":"<jats:p>This article addresses the problem of registering high-resolution, small field-of-view images with low-resolution panoramic images provided by a panoramic catadioptric video sensor. Such systems may find application in surveillance and telepresence systems that require a large field of view and high resolution at selected locations. Although image registration has been studied in more conventional applications, the problem of registering panoramic and conventional video has not previously been addressed, and this problem presents unique challenges due to (i) the extreme differences in resolution between the sensors (more than a 16:1 linear resolution ratio in our application), and (ii) the resolution inhomogeneity of panoramic images. The main contributions of this article are as follows. First, we introduce our foveated panoramic sensor design. Second, we show how a coarse registration can be computed from the raw images using parametric template matching techniques. Third, we propose two refinement methods allowing automatic and near real-time registration between the two image streams. The first registration method is based on matching extracted interest points using a closed form method. The second registration method is featureless and based on minimizing the intensity discrepancy allowing the direct recovery of both the geometric and the photometric transforms. Fourth, a comparison between the two registration methods is carried out, which shows that the featureless method is superior in accuracy. Registration examples using the developed methods are presented.<\/jats:p>","DOI":"10.1145\/2168996.2168997","type":"journal-article","created":{"date-parts":[[2012,5,23]],"date-time":"2012-05-23T15:47:01Z","timestamp":1337788021000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Image registration for foveated panoramic sensing"],"prefix":"10.1145","volume":"8","author":[{"given":"Fadi","family":"Dornaika","sequence":"first","affiliation":[{"name":"University of the Basque Country UPV\/EHU, Spain, and IKERBASQUE, Basque Foundation for Science, San Sebastian, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James H.","family":"Elder","sequence":"additional","affiliation":[{"name":"York University, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,5,22]]},"reference":[{"volume-title":"Proceedings of the IEEE International Conference on Image Processing.","author":"Amintabar A.","key":"e_1_2_1_1_1","unstructured":"Amintabar , A. and Boufama , B . 2008. Homography-based plane identification and matching . In Proceedings of the IEEE International Conference on Image Processing. Amintabar, A. and Boufama, B. 2008. Homography-based plane identification and matching. In Proceedings of the IEEE International Conference on Image Processing."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2007.09.014"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2003.09.005"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-0002-3"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2002.806551"},{"volume-title":"InProceedings of the IEEE Conference on Computer Vision.","author":"Conroy T. L.","key":"e_1_2_1_6_1","unstructured":"Conroy , T. L. and Moore , J. B . September 1999. Resolution invariant surfaces for panoramic vision systems . InProceedings of the IEEE Conference on Computer Vision. Conroy, T. L. and Moore, J. B. September 1999. Resolution invariant surfaces for panoramic vision systems. InProceedings of the IEEE Conference on Computer Vision."},{"volume-title":"Proceedings of the IEEE International Conference on Patter Recognition.","author":"Danilidis K.","key":"e_1_2_1_7_1","unstructured":"Danilidis , K. and Geyer , C . 2000. Omnidirectional vision: Theory and algorithms . In Proceedings of the IEEE International Conference on Patter Recognition. Danilidis, K. and Geyer, C. 2000. Omnidirectional vision: Theory and algorithms. In Proceedings of the IEEE International Conference on Patter Recognition."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the European Conference on Computer Vision. Lecture Notes in Computer Science","volume":"2353","author":"Dornaika F.","unstructured":"Dornaika , F. and Elder , J . 2002. Image registration for foveated omnidirectional sensing . In Proceedings of the European Conference on Computer Vision. Lecture Notes in Computer Science , vol. 2353 . Dornaika, F. and Elder, J. 2002. Image registration for foveated omnidirectional sensing. In Proceedings of the European Conference on Computer Vision. Lecture Notes in Computer Science, vol. 2353."},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Dufourneau Y.","key":"e_1_2_1_9_1","unstructured":"Dufourneau , Y. , Schmid , C. , and Horaud , R . 2000. Matching images with different resolutions . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Dufourneau, Y., Schmid, C., and Horaud, R. 2000. Matching images with different resolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/358669.358692"},{"volume-title":"Practical Methods of Optimization","author":"Fletcher R.","key":"e_1_2_1_11_1","unstructured":"Fletcher , R. 1990. Practical Methods of Optimization . Wiley , New York . Fletcher, R. 1990. Practical Methods of Optimization. Wiley, New York."},{"volume-title":"Proceedings of the Alvey Vision Conference.","author":"Harris C.","key":"e_1_2_1_12_1","unstructured":"Harris , C. and Stephens , M . 1988. A combined corner and edge detector . In Proceedings of the Alvey Vision Conference. Harris, C. and Stephens, M. 1988. A combined corner and edge detector. In Proceedings of the Alvey Vision Conference."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/11919476_3"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision.","author":"Kanatani K.","key":"e_1_2_1_14_1","unstructured":"Kanatani , K. and Ohta , N . 1999. Accuracy bounds and optimal computation of homography for image mosaicing applications . In Proceedings of the IEEE Conference on Computer Vision. Kanatani, K. and Ohta, N. 1999. Accuracy bounds and optimal computation of homography for image mosaicing applications. In Proceedings of the IEEE Conference on Computer Vision."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(03)00071-0"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.106"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"volume-title":"Smart CMOS Image Sensors and Applications","author":"Ohta J.","key":"e_1_2_1_18_1","unstructured":"Ohta , J. 2007. Smart CMOS Image Sensors and Applications . CRC Press , Taylor & Francis Group. Ohta, J. 2007. Smart CMOS Image Sensors and Applications. CRC Press, Taylor & Francis Group."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJISTA.2005.007305"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/794189.794380"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-007-0885-4"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Scaramuzza D. and Siegwart R. 2007. A practical toolbox for calibrating omnidirectional cameras. In Vision Systems: Applications Intech.  Scaramuzza D. and Siegwart R. 2007. A practical toolbox for calibrating omnidirectional cameras. In Vision Systems: Applications Intech.","DOI":"10.5772\/4994"},{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision.","author":"Schwartz W. B.","key":"e_1_2_1_23_1","unstructured":"Schwartz , W. B. , Kembhavi , A. , Harwood , D. , and Davis , L. S . 2009. Human detection using partial least squares analysis . In Proceedings of the IEEE International Conference on Computer Vision. Schwartz, W. B., Kembhavi, A., Harwood, D., and Davis, L. S. 2009. Human detection using partial least squares analysis. In Proceedings of the IEEE International Conference on Computer Vision."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2007.05.009"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-005-3220-1"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Tanaka K.","key":"e_1_2_1_26_1","unstructured":"Tanaka , K. , Sano , M. , Ohara , S. , and Okudaira , M . 2000. A parametric template method and its application to robust matching . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Tanaka, K., Sano, M., Ohara, S., and Okudaira, M. 2000. A parametric template method and its application to robust matching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation.","author":"Torre F.","key":"e_1_2_1_27_1","unstructured":"Torre , F. , Vallespi , C. , Rybski , P. E. , Veloso , M. , and Kanade , T . 2005. Learning to track multiple people in omnidirectional video . In Proceedings of the IEEE International Conference on Robotics and Automation. Torre, F., Vallespi, C., Rybski, P. E., Veloso, M., and Kanade, T. 2005. Learning to track multiple people in omnidirectional video. In Proceedings of the IEEE International Conference on Robotics and Automation."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2009.10.002"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008101718719"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0262-8856(03)00137-9"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2168996.2168997","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2168996.2168997","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:49:08Z","timestamp":1750236548000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2168996.2168997"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,5]]},"references-count":30,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,5]]}},"alternative-id":["10.1145\/2168996.2168997"],"URL":"https:\/\/doi.org\/10.1145\/2168996.2168997","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2012,5]]},"assertion":[{"value":"2010-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-05-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}