{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:11:46Z","timestamp":1760242306736,"version":"build-2065373602"},"reference-count":60,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2017,4,28]],"date-time":"2017-04-28T00:00:00Z","timestamp":1493337600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000053","name":"National Eye Institute","doi-asserted-by":"publisher","award":["1R01EY024666-01"],"award-info":[{"award-number":["1R01EY024666-01"]}],"id":[{"id":"10.13039\/100000053","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>We present a new algorithm for 3D shape reconstruction from stereo image pairs that uses mirror symmetry as a biologically inspired prior. 3D reconstruction requires some form of prior because it is an ill-posed inverse problem. Psychophysical research shows that mirror-symmetry is a key prior for 3D shape perception in humans, suggesting that a general purpose solution to this problem will have many applications. An approach is developed for finding objects that fit a given shape definition. The algorithm is developed for shapes with two orthogonal planes of symmetry, thus allowing for straightforward recovery of occluded portions of the objects. Two simulations were run to test: (1) the accuracy of 3D recovery, and (2) the ability of the algorithm to find the object in the presence of noise. We then tested the algorithm on the Children\u2019s Furniture Corpus, a corpus of stereo image pairs of mirror symmetric furniture objects. Runtimes and 3D reconstruction errors are reported and failure modes described.<\/jats:p>","DOI":"10.3390\/sym9050064","type":"journal-article","created":{"date-parts":[[2017,4,28]],"date-time":"2017-04-28T11:57:04Z","timestamp":1493380624000},"page":"64","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Binocular 3D Object Recovery Using a Symmetry Prior"],"prefix":"10.3390","volume":"9","author":[{"given":"Aaron","family":"Michaux","sequence":"first","affiliation":[{"name":"School of Electrical and Computer Engineering, Purdue University, 465 Northwestern Avenue, West Lafayette, IN 47907, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vikrant","family":"Kumar","sequence":"additional","affiliation":[{"name":"Department of Psychological Sciences, Purdue University, 703 3rd Street, West Lafayette, IN 47907, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3880-2503","authenticated-orcid":false,"given":"Vijai","family":"Jayadevan","sequence":"additional","affiliation":[{"name":"School of Electrical and Computer Engineering, Purdue University, 465 Northwestern Avenue, West Lafayette, IN 47907, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2909-7323","authenticated-orcid":false,"given":"Edward","family":"Delp","sequence":"additional","affiliation":[{"name":"School of Electrical and Computer Engineering, Purdue University, 465 Northwestern Avenue, West Lafayette, IN 47907, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zygmunt","family":"Pizlo","sequence":"additional","affiliation":[{"name":"Department of Psychological Sciences, Purdue University, 703 3rd Street, West Lafayette, IN 47907, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,4,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/0004-3702(77)90020-0","article-title":"Understanding image intensities","volume":"8","author":"Horn","year":"1977","journal-title":"Artif. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/0004-3702(81)90019-9","article-title":"Recovering surface shape and orientation from texture","volume":"17","author":"Witkin","year":"1981","journal-title":"Artif. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1016\/0004-3702(81)90031-X","article-title":"Recovery of the three-dimensional shape of an object from a single view","volume":"17","author":"Kanade","year":"1981","journal-title":"Artif. Intell."},{"key":"ref_4","unstructured":"Marr, D. (1982). Vision: A Computational Investigation into the Human Representation and Processing of Visual Information, Henry Holt and Co., Inc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1016\/j.tics.2007.09.004","article-title":"Learning multiple layers of representation","volume":"11","author":"Hinton","year":"2007","journal-title":"Trends Cogn. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Dickinson, S. (2009). Challenge of image abstraction. Object Categorization: Computer and Human Vision Perspectives, Cambridge University Press.","DOI":"10.1017\/CBO9780511635465"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Chalmers, A., Reinhard, E., and Davis, T. (2002). Practical Parallel Rendering, CRC Press.","DOI":"10.1201\/b10622"},{"key":"ref_8","unstructured":"Tikhonov, A.N., and Arsenin, V.Y. (1977). Solutions of Ill-Posed Problems, Winston."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1038\/317314a0","article-title":"Computational vision and regularization theory","volume":"317","author":"Poggio","year":"1985","journal-title":"Nature"},{"key":"ref_10","unstructured":"Pinker, S. (1997). How the Mind Works, W. W. Norton & Company."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tsotsos, J.K. (2011). A Computational Perspective on Visual Attention, MIT Press.","DOI":"10.7551\/mitpress\/9780262015417.001.0001"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pizlo, Z., Li, Y., Sawada, T., and Steinman, R. (2014). Making a Machine That Sees Like Us, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199922543.001.0001"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1037\/0096-1523.14.1.3","article-title":"Mental rotation: Effects of dimensionality of objects and type of task","volume":"14","author":"Shepard","year":"1988","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/S0960-9822(00)00004-X","article-title":"The importance of symmetry and virtual views in three-dimensional object recognition","volume":"4","author":"Vetter","year":"1994","journal-title":"Curr. Biol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sawada, T., Li, Y., and Pizlo, Z. (2015). Shape Perception. The Oxford Handbook of Computational and Mathematical Psychology, Oxford University Press.","DOI":"10.1093\/oxfordhb\/9780199957996.013.12"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, Y., Sawada, T., Shi, Y., Steinman, R., and Pizlo, Z. (2013). Symmetry Is the sine qua non of Shape. Shape Perception in Human and Computer Vision, Springer.","DOI":"10.1007\/978-1-4471-5195-1_2"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1167\/11.4.11","article-title":"A Bayesian model of binocular perception of 3D mirror symmetrical polyhedra","volume":"11","author":"Li","year":"2011","journal-title":"J. Vis."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Palmer, E., Michaux, A., and Pizlo, Z. (2016, January 19\u201323). Using virtual environments to evaluate assumptions of the human visual system. Proceedings of the 2016 IEEE Virtual Reality (VR), Greenville, SC, USA.","DOI":"10.1109\/VR.2016.7504751"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1098\/rspb.1978.0020","article-title":"Representation and Recognition of the Spatial Organization of Three-Dimensional Shapes","volume":"200","author":"Marr","year":"1978","journal-title":"Proc. R. Soc. Lond. B Biol. Sci."},{"key":"ref_20","unstructured":"Binford, T. (1971, January 15\u201317). Visual perception by computer. Proceedings of the IEEE Conference on Systems and Control, Miami, FL, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gordon, G. (1990, January 1). Shape from symmetry. Proceedings of the Intelligent Robots and Computer Vision VIII: Algorithms and Techniques, Philadelphia, PA, USA.","DOI":"10.1117\/12.969742"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_23","unstructured":"Rothwell, C., Forsyth, D., Zisserman, A., and Mundy, J. (1993, January 11\u201314). Extracting projective structure from single perspective views of 3D point sets. Proceedings of the Fourth IEEE International Conference on Computer Vision, Berlin, Germany."},{"key":"ref_24","unstructured":"Carlsson, S. (1998). European Conference on Computer Vision, Springer."},{"key":"ref_25","unstructured":"Van Gool, L., Moons, T., and Proesmans, M. (1998, January 18\u201320). Mirror and Point Symmetry under Perspective Skewing. Proceedings of the Computer Vision and Pattern Recognition, San Francisco, CA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1023\/B:VISI.0000036837.76476.10","article-title":"On symmetry and multiple-view geometry: Structure, pose, and calibration from a single image","volume":"60","author":"Hong","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Penne, R. (2005). Mirror symmetry in perspective. International Conference on Advanced Concepts for Intelligent Vision Systems, Springer.","DOI":"10.1007\/11558484_80"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"365","DOI":"10.3390\/sym3020365","article-title":"Any pair of 2D curves is consistent with a 3D symmetric interpretation","volume":"3","author":"Sawada","year":"2011","journal-title":"Symmetry"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/0262-8856(95)99731-F","article-title":"Symmetry detection through local skewed symmetries","volume":"13","author":"Cham","year":"1995","journal-title":"Image Vis. Comput."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cham, T., and Cipolla, R. (1996). Geometric saliency of curve correspondences and grouping of symmetric contours. European Conference on Computer Vision, Springer.","DOI":"10.1007\/BFb0015552"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Cornelius, H., and Loy, G. (2006, January 17\u201322). Detecting bilateral symmetry in perspective. Proceedings of the IEEE Computer Vision and Pattern Recognition Workshop, New York, NY, USA.","DOI":"10.1109\/CVPRW.2006.63"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Cornelius, H., Perd\u2019och, M., Matas, J., and Loy, G. (2007). Efficient symmetry detection using local affine frames. Scandinavian Conference on Image Analysis, Springer.","DOI":"10.1007\/978-3-540-73040-8_16"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1023\/A:1008118909580","article-title":"Shape reconstruction of 3D bilaterally symmetric surfaces","volume":"39","author":"Shimshoni","year":"2000","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"K\u00f6ser, K., Zach, C., and Pollefeys, M. (2011). Dense 3D reconstruction of symmetric scenes from a single image. Joint Pattern Recognition Symposium, Springer.","DOI":"10.1007\/978-3-642-23123-0_27"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wu, C., Frahm, J., and Pollefeys, M. (2011, January 20\u201325). Repetition-based dense single-view reconstruction. Proceedings of the IEEE Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995551"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.cviu.2005.01.004","article-title":"Symmetry-based 3D reconstruction from perspective images","volume":"99","author":"Yang","year":"2005","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1111\/j.1467-8659.2009.01410.x","article-title":"Symmetry detection using feature lines","volume":"28","author":"Bokeloh","year":"2009","journal-title":"Comput. Graph. Forum"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1650","DOI":"10.1109\/TVCG.2010.258","article-title":"Sketching of mirror-symmetric shapes","volume":"17","author":"Cordier","year":"2011","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/j.cad.2012.10.013","article-title":"Inferring mirror symmetric 3D shapes from sketches","volume":"45","author":"Cordier","year":"2013","journal-title":"Comput.-Aided Des."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"\u00d6ztireli, A., Uyumaz, U., Popa, T., Sheffer, A., and Gross, M. (2011, January 5\u20137). 3D modeling with a symmetric sketch. Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling, Vancouver, BC, Canada.","DOI":"10.1145\/2021164.2021169"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Sinha, S., Ramnath, K., and Szeliski, R. (2012). Detecting and Reconstructing 3D Mirror Symmetric Objects. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-642-33709-3_42"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Gao, Y., and Yuille, A. (2016). Symmetric bon-rigid structure from motion for category-specific object structure estimation. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46475-6_26"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Cohen, A., Zach, C., Sinha, S., and Pollefeys, M. (2012, January 16\u201321). Discovering and exploiting 3D symmetries in structure from motion. Proceedings of the IEEE Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247841"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"061606","DOI":"10.1117\/1.JEI.25.6.061606","article-title":"Figure-ground organization based on three-dimensional symmetry","volume":"25","author":"Michaux","year":"2016","journal-title":"J. Electron. Imaging"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1006\/cviu.1996.0506","article-title":"Using bilateral symmetry to improve 3D reconstruction from image sequences","volume":"67","author":"Zabrodsky","year":"1997","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.jmp.2012.07.001","article-title":"A tutorial explaining a machine vision model that emulates human performance when it recovers natural 3D scenes from 2D images","volume":"56","author":"Li","year":"2012","journal-title":"J. Math. Psychol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A computational approach to edge detection","volume":"6","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1145\/93605.98741","article-title":"The R*-tree: An efficient and robust access method for points and rectangles","volume":"19","author":"Beckmann","year":"1990","journal-title":"ACM Sigmod Rec."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1162\/089976603765202668","article-title":"Manhattan world: Orientation and outlier detection by bayesian inference","volume":"15","author":"Coughlan","year":"2003","journal-title":"Neural Comput."},{"key":"ref_50","unstructured":"Bradski, G. (2017, January 16). The OpenCV Library. Available online: http:\/\/www.drdobbs.com\/open-source\/the-opencv-library\/184404319."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_52","unstructured":"Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Fourth Alvey Vision Conference, Manchester, UK."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1080\/00401706.1975.10489269","article-title":"The Nelder\u2013Mead simplex procedure for function minimization","volume":"17","author":"Olsson","year":"1975","journal-title":"Technometrics"},{"key":"ref_54","unstructured":"Fran\u00e7ois, A., Medioni, G., and Waupotitsch, R. (2002, January 11\u201315). Reconstructing mirror symmetric scenes from a single view using 2-view stereo geometry. Proceedings of the IEEE International Conference on Pattern Recognition, Quebec, QC, Canada."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1016\/0262-8856(94)90015-9","article-title":"Extracting structure from an affine view of a 3D point set with one or two bilateral symmetries","volume":"12","author":"Fawcett","year":"1994","journal-title":"Image Vis. Comput."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1109\/34.161352","article-title":"3D reconstruction using mirror images based on a plane symmetry recovering method","volume":"14","author":"Mitsumoto","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Huynh, D. (1999, January 20\u201327). Affine reconstruction from monocular vision in the presence of a symmetry plane. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.791259"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1588","DOI":"10.1109\/JPROC.2014.2344001","article-title":"Detecting 3D mirror symmetry in a 2D camera image for 3D shape recovery","volume":"102","author":"Sawada","year":"2014","journal-title":"Proc. IEEE"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Li, B., Peng, K., Ying, X., and Zha, H. (2010). Simultaneous vanishing point detection and camera calibration from single images. International Symposium on Visual Computing, Springer.","DOI":"10.1007\/978-3-642-17274-8_15"},{"key":"ref_60","unstructured":"Pirenne, M. (1970). Optics, Painting & Photography;, Cambridge University Press."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/9\/5\/64\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:34:08Z","timestamp":1760207648000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/9\/5\/64"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,4,28]]},"references-count":60,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2017,5]]}},"alternative-id":["sym9050064"],"URL":"https:\/\/doi.org\/10.3390\/sym9050064","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2017,4,28]]}}}