{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:01:30Z","timestamp":1760241690269,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2018,7,14]],"date-time":"2018-07-14T00:00:00Z","timestamp":1531526400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"publisher","award":["R01EB019460"],"award-info":[{"award-number":["R01EB019460"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>An optimal camera placement problem is investigated. The objective is to maximize the area of the field of view (FoV) of a stitched video obtained by stitching video streams from an array of cameras. The positions and poses of these cameras are restricted to a given set of selections. The camera array is designed to be placed inside the abdomen to support minimally invasive laparoscopic surgery. Hence, a few non-traditional requirements\/constraints are imposed: Adjacent views are required to overlap to support image registration for seamless video stitching. The resulting effective FoV should be a contiguous region without any holes and should be a convex polygon. With these requirements, traditional camera placement algorithms cannot be directly applied to solve this problem. In this work, we show the complexity of this problem grows exponentially as a function of the problem size, and then present a greedy polynomial time heuristic solution that approximates well to the globally optimal solution. We present a new approach to directly evaluate the combined coverage area (area of FoV) as the union of a set of quadrilaterals. We also propose a graph-based approach to ensure the stitching requirement (overlap between adjacent views) is satisfied. We present a method to find a convex polygon with maximum area from a given polygon. Several design examples show that the proposed algorithm can achieve larger FoV area while using much less computing time.<\/jats:p>","DOI":"10.3390\/s18072284","type":"journal-article","created":{"date-parts":[[2018,7,16]],"date-time":"2018-07-16T04:05:33Z","timestamp":1531713933000},"page":"2284","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Optimal Camera Pose and Placement Configuration for Maximum Field-of-View Video Stitching"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0861-1781","authenticated-orcid":false,"given":"Alex J.","family":"Watras","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Wisconsin\u2014Madison, 1415 Engineering Dr, Madison, WI 53706, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0722-3402","authenticated-orcid":false,"given":"Jae-Jun","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Wisconsin\u2014Madison, 1415 Engineering Dr, Madison, WI 53706, USA"}]},{"given":"Hewei","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Wisconsin\u2014Madison, 1415 Engineering Dr, Madison, WI 53706, USA"}]},{"given":"Yu Hen","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Wisconsin\u2014Madison, 1415 Engineering Dr, Madison, WI 53706, USA"}]},{"given":"Hongrui","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Wisconsin\u2014Madison, 1415 Engineering Dr, Madison, WI 53706, USA"},{"name":"Department of Biomedical Engineering, University of Wisconsin\u2014Madison,1550 Engineering Dr, Madison, WI 53706, USA"},{"name":"Department of Ophthalmology and Visual Sciences, University of Wisconsin\u2014Madison, 2828 Marshall Ct, Suite 200 Madison, WI 53706, USA"}]}],"member":"1968","published-online":{"date-parts":[[2018,7,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Hengstler, S., Prashanth, D., Fong, S., and Aghajan, H. (2007, January 25\u201327). MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance. Proceedings of the 6th International Conference on Information Processing in Sensor Networks, Cambridge, MA, USA.","DOI":"10.1109\/IPSN.2007.4379696"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Carrera, G., Angeli, A., and Davison, A.J. (2011, January 9\u201313). SLAM-based automatic extrinsic calibration of a multi-camera rig. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980294"},{"key":"ref_3","unstructured":"Cabral, B.K. (2017, November 05). Introducing Facebook Surround 360: An Open, High-Quality 3D-360 Video Capture System. Available online: https:\/\/code.facebook.com\/posts\/1755691291326688."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1145\/2980179.2980257","article-title":"Jump: Virtual reality video","volume":"35","author":"Anderson","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_5","unstructured":"(2017, November 05). Gopro-Omni All Inclusive Synchronized 6-Camera Array. Available online: https:\/\/shop.gopro.com\/virtualreality\/omni-all-inclusive\/MHDHX-006.html."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1290","DOI":"10.1109\/JMEMS.2014.2360124","article-title":"Multicamera laparoscopic imaging with tunable focusing capability","volume":"23","author":"Kanhere","year":"2014","journal-title":"J. Microelectromech. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1109\/70.345940","article-title":"A survey of sensor planning in computer vision","volume":"11","author":"Tarabanis","year":"1995","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/s11263-012-0587-7","article-title":"Modeling coverage in camera networks: A survey","volume":"101","author":"Mavrinac","year":"2013","journal-title":"Int. J. Comput. Vis."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"241913","DOI":"10.1155\/2013\/241913","article-title":"Approximate techniques in solving optimal camera placement problems","volume":"9","author":"Zhao","year":"2013","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/0600000009","article-title":"Image Alignment and Stitching: A Tutorial","volume":"2","author":"Szeliski","year":"2016","journal-title":"Found. Trends Comput. Graph. Vis."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1988","DOI":"10.3390\/s140201988","article-title":"Surveillance of a 2D plane area with 3D deployed cameras","volume":"14","author":"Fu","year":"2014","journal-title":"Sensors"},{"key":"ref_12","unstructured":"Piciarelli, C., Micheloni, C.C., and Foresti, G.L. (September, January 30). PTZ camera network reconfiguration. Proceedings of the Third ACM\/IEEE International Conference on Distributed Smart Cameras, Como, Italy."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/BF00183192","article-title":"On the Largest Convex Polygon Contained in a Non-convex n-gon, or how to peel a potato","volume":"11","author":"Goodman","year":"1981","journal-title":"Geom. Dedicata"},{"key":"ref_14","unstructured":"Woo, T.C. (1981). The Convex Skull Problem, Department of Industrial and Operations Engineering, University of Michigan. Technical Report TR 86-31."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/BF02187692","article-title":"A polynomial solution for the potato-peeling problem","volume":"1","author":"Chang","year":"1986","journal-title":"Discret. Comput. Geom."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Horster, E., and Lienhart, R. (2006, January 23\u201327). On the Optimal Placement of Multiple Visual Sensors. Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor Networks, Santa Barbara, CA, USA.","DOI":"10.1145\/1178782.1178800"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Urrutia, J. (2000). Art Gallery and Illumination Problems. Handbook of Computational Geometry, Elsevier Science.","DOI":"10.1016\/B978-044482537-7\/50023-1"},{"key":"ref_18","unstructured":"Erdem, U.M., and Sclaroff, S. (2018, July 14). Optimal Placement of Cameras in Floorplans to Satisfy Task Requirements and Cost Constraints. Available online: https:\/\/www.researchgate.net\/profile\/Stan_Sclaroff\/publication\/228960034_Optimal_placement_of_cameras_in_floorplans_to_satisfy_task_requirements_and_cost_constraints\/links\/00b7d51dfdfbaf0412000000.pdf."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Horster, E., and Lienhart, R. (2009). Optimal Placement of Visual Sensors. Multi-Camera Networks: Concepts and Applications, Elsevier.","DOI":"10.1016\/B978-0-12-374633-7.00007-0"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.1007\/s11590-016-1014-8","article-title":"A unified solving approach for two and three dimensional coverage problems in sensor networks","volume":"10","author":"Sterle","year":"2016","journal-title":"Optim. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1448","DOI":"10.1109\/TC.2002.1146711","article-title":"Grid coverage for surveillance and target location in distributed sensor networks","volume":"51","author":"Chakrabarty","year":"2002","journal-title":"IEEE Trans. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"11453","DOI":"10.3390\/s130911453","article-title":"A Sparse Representation-Based Deployment Method for Optimizing the Observation Quality of Camera Networks","volume":"13","author":"Wang","year":"2013","journal-title":"Sensors"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Angella, F., Reithler, L., and Gallesio, F. (2007, January 5\u20137). Optimal deployment of cameras for video surveillance systems. Proceedings of the 2007 IEEE Conference on Advanced Video and Signal Based Surveillance, London, UK.","DOI":"10.1109\/AVSS.2007.4425342"},{"key":"ref_24","unstructured":"Malik, R., and Bajcsy, P. (2008, January 17). Automated placement of multiple stereo cameras. Proceedings of the 8th ECCV Workshop on Omnidirectional Vision, Camera Networks and Non-Classical Cameras, Marseille, France."},{"key":"ref_25","unstructured":"Aghajan, H., and Cavallaro, A. (2009). Optimal visual sensor network configuration. Multi-Camera Networks: Principles and Applications, Academic Press. Chapter 6."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chabra, R., Ilie, A., Rewkowski, N., Cha, Y.W., and Fuchs, H. (2017, January 18\u201322). Optimizing placement of commodity depth cameras for known 3D dynamic scene capture. Proceedings of the 2017 IEEE Virtual Reality (VR), Los Angeles, CA, USA.","DOI":"10.1109\/VR.2017.7892243"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"10126","DOI":"10.3182\/20140824-6-ZA-1003.01097","article-title":"Optimization for 3D model-based multi-camera deployment","volume":"47","author":"Zhang","year":"2014","journal-title":"IFAC Proc. Vol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3157","DOI":"10.1109\/TMECH.2015.2411593","article-title":"3-D model-based multi-camera deployment: A recursive convex optimization approach","volume":"20","author":"Zhang","year":"2015","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/LSENS.2017.2758371","article-title":"Modeling multicamera coverage for placement optimization","volume":"1","author":"Altahir","year":"2017","journal-title":"IEEE Sens. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1145\/129902.129906","article-title":"A generic solution to polygon clipping","volume":"35","author":"Vatti","year":"1992","journal-title":"Commun. ACM"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"9866","DOI":"10.1016\/j.amc.2012.03.063","article-title":"Finding the largest area rectangle of arbitrary orientation in a closed contour","volume":"218","author":"Molano","year":"2012","journal-title":"Appl. Math. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.jda.2012.01.002","article-title":"Largest inscribed rectangles in convex polygons","volume":"13","author":"Knauer","year":"2012","journal-title":"J. Discret. Algorithms"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hall-Holt, O., Katz, M.J., Kumar, P., Mitchell, J.S., and Sityon, A. (2006, January 22\u201324). Finding large sticks and potatoes in polygons. Proceedings of the Seventeenth Annual ACM-SIAM Symposium on Discrete Algorithm, Miami, FL, USA.","DOI":"10.1145\/1109557.1109610"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Culberson, J.C., and Reckhow, R.A. (1988, January 24\u201326). Covering polygons is hard. Proceedings of the 29th Annual Symposium on Foundations of Computer Science, White Plains, NY, USA.","DOI":"10.1109\/SFCS.1988.21976"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1109\/TIT.1983.1056648","article-title":"Some NP-hard polygon decomposition problems","volume":"29","author":"Orourke","year":"1983","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wilburn, B. (August, January 30). High-performance imaging with large camera arrays. Proceedings of the ACM SIGGRAPH 2006 Courses (SIGGRAPH 06), Boston, MA, USA.","DOI":"10.1145\/1185657.1185701"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/7\/2284\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:12:13Z","timestamp":1760195533000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/7\/2284"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,14]]},"references-count":36,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2018,7]]}},"alternative-id":["s18072284"],"URL":"https:\/\/doi.org\/10.3390\/s18072284","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,7,14]]}}}