{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:50:41Z","timestamp":1760241041178,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2019,11,15]],"date-time":"2019-11-15T00:00:00Z","timestamp":1573776000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Flemish Fund for Scientific Research FWO-Flanders","award":["3G014718"],"award-info":[{"award-number":["3G014718"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Extrinsic camera calibration is essential for any computer vision task in a camera network. Typically, researchers place a calibration object in the scene to calibrate all the cameras in a camera network. However, when installing cameras in the field, this approach can be costly and impractical, especially when recalibration is needed. This paper proposes a novel, accurate and fully automatic extrinsic calibration framework for camera networks with partially overlapping views. The proposed method considers the pedestrians in the observed scene as the calibration objects and analyzes the pedestrian tracks to obtain extrinsic parameters. Compared to the state of the art, the new method is fully automatic and robust in various environments. Our method detect human poses in the camera images and then models walking persons as vertical sticks. We apply a brute-force method to determines the correspondence between persons in multiple camera images. This information along with 3D estimated locations of the top and the bottom of the pedestrians are then used to compute the extrinsic calibration matrices. We also propose a novel method to calibrate the camera network by only using the top and centerline of the person when the bottom of the person is not available in heavily occluded scenes. We verified the robustness of the method in different camera setups and for both single and multiple walking people. The results show that the triangulation error of a few centimeters can be obtained. Typically, it requires less than one minute of observing the walking people to reach this accuracy in controlled environments. It also just takes a few minutes to collect enough data for the calibration in uncontrolled environments. Our proposed method can perform well in various situations such as multi-person, occlusions, or even at real intersections on the street.<\/jats:p>","DOI":"10.3390\/s19224989","type":"journal-article","created":{"date-parts":[[2019,11,15]],"date-time":"2019-11-15T11:25:56Z","timestamp":1573817156000},"page":"4989","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Automatic Multi-Camera Extrinsic Parameter Calibration Based on Pedestrian Torsors \u2020"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2376-927X","authenticated-orcid":false,"given":"Anh Minh","family":"Truong","sequence":"first","affiliation":[{"name":"TELIN-IPI, Ghent University\u2014imec, St-Pietersnieuwstraat 41, B-9000 Gent, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wilfried","family":"Philips","sequence":"additional","affiliation":[{"name":"TELIN-IPI, Ghent University\u2014imec, St-Pietersnieuwstraat 41, B-9000 Gent, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9300-5860","authenticated-orcid":false,"given":"Nikos","family":"Deligiannis","sequence":"additional","affiliation":[{"name":"ETRO Department, Vrije Universiteit Brussel\u2014imec, Pleinlaan 2, B-1050 Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lusine","family":"Abrahamyan","sequence":"additional","affiliation":[{"name":"ETRO Department, Vrije Universiteit Brussel\u2014imec, Pleinlaan 2, B-1050 Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junzhi","family":"Guan","sequence":"additional","affiliation":[{"name":"CETC Key Laboratory of Aerospace Information Applications, Shijiazhuang 050000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dimitrievski, M., Veelaert, P., and Philips, W. (2019). Behavioral pedestrian tracking using a camera and lidar sensors on a moving vehicle. Sensors, 19.","DOI":"10.3390\/s19020391"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1145\/2487228.2487238","article-title":"Depth Synthesis and Local Warps for Plausible Image-based Navigation","volume":"32","author":"Chaurasia","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sebe, I.O., Hu, J., You, S., and Neumann, U. (2003, January 2\u20138). 3D Video Surveillance with Augmented Virtual Environments. Proceedings of the First ACM SIGMM International Workshop on Video Surveillance (IWVS \u201903), Berkeley, CA, USA.","DOI":"10.1145\/982452.982466"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1632","DOI":"10.1109\/TIFS.2013.2265089","article-title":"Transferring Training Instances for Convenient Cross-View Object Classification in Surveillance","volume":"8","author":"Zhang","year":"2013","journal-title":"Trans. Inf. For. Sec."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MC.1982.1653915","article-title":"Measuring Curved Surfaces for Robot Vision","volume":"15","author":"Hall","year":"1982","journal-title":"Computer"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1109\/JRA.1987.1087109","article-title":"A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses","volume":"3","author":"Tsai","year":"1987","journal-title":"IEEE J. Robot. Autom."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hartley, R.I. (1994, January 21\u201323). An algorithm for self calibration from several views. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR.1994.323923"},{"key":"ref_9","unstructured":"Liu, J., Collins, R., and Liu, Y. (September, January 28). Surveillance camera autocalibration based on pedestrian height distributions. Proceedings of the British Machine Vision Conference, Dundee, UK."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, J., Collins, R., and Liu, Y. (2013, January 15\u201317). Robust autocalibration for a surveillance camera network. Proceedings of the IEEE Workshop on Applications of Computer Vision, Clearwater Beach, FL, USA.","DOI":"10.1109\/WACV.2013.6475051"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1186\/s13640-015-0086-1","article-title":"A simplified nonlinear regression method for human height estimation in video surveillance","volume":"2015","author":"Li","year":"2015","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1109\/TPAMI.2006.178","article-title":"Camera calibration from video of a walking human","volume":"28","author":"Lv","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","unstructured":"Possegger, H., R\u00fcther, M., Sternig, S., Mauthner, T., Klopschitz, M., Roth, P.M., and Bischof, H. (2012, January 9\u201311). Unsupervised Calibration of Camera Networks and Virtual PTZ Cameras. Proceedings of the Computer Vision Winter Workshop, Breckenridge, CO, USA."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Guan, J., Deboeverie, F., Slembrouck, M., Van Haerenborgh, D., Van Cauwelaert, D., Veelaert, P., and Philips, W. (2016). Extrinsic calibration of camera networks based on pedestrians. Sensors, 16.","DOI":"10.3390\/s16050654"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S.E., and Sheikh, Y. (2017, January 21\u201326). Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. Proceedings of the Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., and Sheikh, Y. (2018). OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_17","unstructured":"Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., and Sheikh, Y. (2016, January 27\u201330). Convolutional pose machines. Proceedings of the Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fang, H.S., Xie, S., Tai, Y.W., and Lu, C. (2017, January 22\u201329). RMPE: Regional Multi-person Pose Estimation. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.256"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Simon, T., Joo, H., Matthews, I., and Sheikh, Y. (2017, January 21\u201326). Hand Keypoint Detection in Single Images using Multiview Bootstrapping. Proceedings of the Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.494"},{"key":"ref_20","unstructured":"Xiu, Y., Li, J., Wang, H., Fang, Y., and Lu, C. (2018, January 3\u20136). Pose Flow: Efficient Online Pose Tracking. Proceedings of the British Machine Vision Conference (BMVC), Newcastle, UK."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xiao, B., Wu, H., and Wei, Y. (2018, January 8\u201314). Simple Baselines for Human Pose Estimation and Tracking. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01231-1_29"},{"key":"ref_22","unstructured":"Lv, F., Zhao, T., and Nevatia, R. (2002, January 11\u201315). Self-calibration of a camera from video of a walking human. Proceedings of the Object Recognition Supported by User Interaction for Service Robots, Quebec, QC, Canada."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bebis, G., Boyle, R., Parvin, B., Koracin, D., McMahan, R., Jerald, J., Zhang, H., Drucker, S.M., Kambhamettu, C., and El Choubassi, M. (2014). Scene Understanding for Auto-Calibration of Surveillance Cameras. Advances in Visual Computing, Springer International Publishing.","DOI":"10.1007\/978-3-319-14249-4"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"H\u00f6dlmoser, M., and Kampel, M. (2010). Multiple Camera Self-calibration and 3D Reconstruction Using Pedestrians. Advances in Visual Computing, Springer.","DOI":"10.1007\/978-3-642-17274-8_1"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1023\/A:1007984508483","article-title":"Chirality","volume":"26","author":"Hartley","year":"1998","journal-title":"Int. J. Comput. Vis."},{"key":"ref_26","unstructured":"Werner, T., and Pajdla, T. (2001, January 7\u201314). Cheirality in epipolar geometry. Proceedings of the Eighth IEEE International Conference on Computer Vision (ICCV 2001), Vancouver, BC, Canada."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1008109111715","article-title":"Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters","volume":"32","author":"Pollefeys","year":"1999","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2691","DOI":"10.1109\/78.107418","article-title":"Motion and structure from point correspondences with error estimation: planar surfaces","volume":"39","author":"Weng","year":"1991","journal-title":"IEEE Trans. Signal Process"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1142\/S0218001488000285","article-title":"Motion and Structure from Motion in a Piecewise Planar Environment","volume":"2","author":"Faugeras","year":"1988","journal-title":"Int. J. Pattern Recognit. Artif Intell. IJPRAI"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1007\/978-3-319-54184-6_25","article-title":"Markov Chain Monte Carlo Cascade for Camera Network Calibration Based on Unconstrained Pedestrian Tracklets","volume":"10112","author":"Lai","year":"2017","journal-title":"Computer Vision \u2013 ACCV 2016"},{"key":"ref_31","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/BF02289451","article-title":"A generalized solution of the orthogonal procrustes problem","volume":"31","year":"1966","journal-title":"Psychometrika"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_35","unstructured":"Ma, Y., Soatto, S., Kosecka, J., and Sastry, S.S. (2003). An Invitation to 3-D Vision: From Images to Geometric Models, Springer."},{"key":"ref_36","unstructured":"Bouguet, J.Y. (2019, April 14). Camera Calibration Toolbox for Matlab. Available online: http:\/\/www.vision.caltech.edu\/bouguetj\/calib_doc\/."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1806","DOI":"10.1109\/TPAMI.2011.21","article-title":"Multiple Object Tracking Using K-Shortest Paths Optimization","volume":"33","author":"Berclaz","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ferryman, J., and Shahrokni, A. (2009, January 7\u20139). PETS2009: Dataset and challenge. Proceedings of the 2009 Twelfth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, Snowbird, UT, USA.","DOI":"10.1109\/PETS-WINTER.2009.5399556"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/22\/4989\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:34:56Z","timestamp":1760189696000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/22\/4989"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,15]]},"references-count":38,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["s19224989"],"URL":"https:\/\/doi.org\/10.3390\/s19224989","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,11,15]]}}}