{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T13:29:57Z","timestamp":1760016597479,"version":"3.41.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000879","name":"Alfred P. Sloan Foundation","doi-asserted-by":"publisher","award":["FG202013153"],"award-info":[{"award-number":["FG202013153"]}],"id":[{"id":"10.13039\/100000879","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1652569,2008464,1900849"],"award-info":[{"award-number":["1652569,2008464,1900849"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>Full surround 3D imaging for shape acquisition is essential for generating digital replicas of real-world objects. Surrounding an object we seek to scan with a kaleidoscope, that is, a configuration of multiple planar mirrors, produces an image of the object that encodes information from a combinatorially large number of virtual viewpoints. This information is practically useful for the full surround 3D reconstruction of the object, but cannot be used directly, as we do not know what virtual viewpoint each image pixel corresponds---the pixel label. We introduce a structured light system that combines a projector and a camera with a kaleidoscope. We then prove that we can accurately determine the labels of projector and camera pixels, for arbitrary kaleidoscope configurations, using the projector-camera epipolar geometry. We use this result to show that our system can serve as a multi-view structured light system with hundreds of virtual projectors and cameras. This makes our system capable of scanning complex shapes precisely and with full coverage. We demonstrate the advantages of the kaleidoscopic structured light system by scanning objects that exhibit a large range of shapes and reflectances.<\/jats:p>","DOI":"10.1145\/3478513.3480524","type":"journal-article","created":{"date-parts":[[2021,12,10]],"date-time":"2021-12-10T18:28:45Z","timestamp":1639160925000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Kaleidoscopic structured light"],"prefix":"10.1145","volume":"40","author":[{"given":"Byeongjoo","family":"Ahn","sequence":"first","affiliation":[{"name":"Carnegie Mellon University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ioannis","family":"Gkioulekas","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aswin C.","family":"Sankaranarayanan","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,12,10]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073693"},{"key":"e_1_2_2_2_1","volume-title":"Sankaranarayanan","author":"Ahn Byeongjoo","year":"2021","unstructured":"Byeongjoo Ahn , Ioannis Gkioulekas , and Aswin C . Sankaranarayanan . 2021 . Project page: Kaleidoscopic structured light. https:\/\/imaging.cs.cmu.edu\/kaleidoscopic_structured_light Byeongjoo Ahn, Ioannis Gkioulekas, and Aswin C. Sankaranarayanan. 2021. Project page: Kaleidoscopic structured light. https:\/\/imaging.cs.cmu.edu\/kaleidoscopic_structured_light"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1029949.1029979"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.121791"},{"key":"e_1_2_2_5_1","unstructured":"David Brewster. 1858. The kaleidoscope its history theory and construction: with its application to theft ne and useful arts. J. Murray.  David Brewster. 1858. The kaleidoscope its history theory and construction: with its application to theft ne and useful arts. J. Murray."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540082"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/358669.358692"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744047_13"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12201"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383894.2383926"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024163"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011172403203"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.982902"},{"key":"e_1_2_2_14_1","volume-title":"Design of a single-lens stereo camera system. Pattern Recognition 26, 6","author":"Goshtasby Ardeshir","year":"1993","unstructured":"Ardeshir Goshtasby and William A Gruver . 1993. Design of a single-lens stereo camera system. Pattern Recognition 26, 6 ( 1993 ). Ardeshir Goshtasby and William A Gruver. 1993. Design of a single-lens stereo camera system. Pattern Recognition 26, 6 (1993)."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882341"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/861369"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1833349.1778836"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/142920.134011"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.88"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2012.6239347"},{"key":"e_1_2_2_22_1","first-page":"1","article-title":"2017. Panoptic studio: A massively multiview system for social interaction capture","volume":"41","author":"Joo Hanbyul","year":"2017","unstructured":"Hanbyul Joo , Tomas Simon , Xulong Li , Hao Liu , Lei Tan , Lin Gui , Sean Banerjee , Timothy Godisart , Bart Nabbe , Iain Matthews , 2017. Panoptic studio: A massively multiview system for social interaction capture . IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 41 , 1 ( 2017 ). Hanbyul Joo, Tomas Simon, Xulong Li, Hao Liu, Lei Tan, Lin Gui, Sean Banerjee, Timothy Godisart, Bart Nabbe, Iain Matthews, et al. 2017. Panoptic studio: A massively multiview system for social interaction capture. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 41, 1 (2017).","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356492"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.504"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008191222954"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2009.03.016"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00606"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_24"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.161352"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DIMPVT.2012.77"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1995.1021"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275017"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/938978.939044"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2011.6092378"},{"volume-title":"http:\/\/www.nextengine.com [Accessed","year":"2021","key":"e_1_2_2_36_1","unstructured":"NextEngine. 2000. . http:\/\/www.nextengine.com [Accessed Sep. 9, 2021 ]. NextEngine. 2000. . http:\/\/www.nextengine.com [Accessed Sep. 9, 2021]."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2016.43"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2459902"},{"key":"e_1_2_2_39_1","volume-title":"Robust multiview photometric stereo using planar mesh parameterization","author":"Park Jaesik","year":"2016","unstructured":"Jaesik Park , Sudipta N Sinha , Yasuyuki Matsushita , Yu-Wing Tai , and In So Kweon . 2016. Robust multiview photometric stereo using planar mesh parameterization . IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 39, 8 ( 2016 ). Jaesik Park, Sudipta N Sinha, Yasuyuki Matsushita, Yu-Wing Tai, and In So Kweon. 2016. Robust multiview photometric stereo using planar mesh parameterization. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 39, 8 (2016)."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995579"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/2600281.2600288"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540172"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866158.1866194"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2015.25"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.46"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2021.3070347"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2498617"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12600"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980248"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00651"},{"key":"e_1_2_2_51_1","unstructured":"Lior Yariv Yoni Kasten Dror Moran Meirav Galun Matan Atzmon Basri Ronen and Yaron Lipman. 2020. Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance. In Neural Information Processing Systems (NeurIPS).  Lior Yariv Yoni Kasten Dror Moran Meirav Galun Matan Atzmon Basri Ronen and Yaron Lipman. 2020. Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance. In Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540088"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.195"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480524","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480524","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480524","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:49Z","timestamp":1750191109000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480524"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":53,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1145\/3478513.3480524"],"URL":"https:\/\/doi.org\/10.1145\/3478513.3480524","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"2021-12-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}