{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T16:12:48Z","timestamp":1782317568128,"version":"3.54.5"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2017,11,20]],"date-time":"2017-11-20T00:00:00Z","timestamp":1511136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000005","name":"U.S. Department of Defense","doi-asserted-by":"publisher","award":["N00014-13- 1-0341"],"award-info":[{"award-number":["N00014-13- 1-0341"]}],"id":[{"id":"10.13039\/100000005","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004344","name":"Adobe Systems","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004344","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004675","name":"Autodesk","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004675","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"publisher","award":["Google focused research award,"],"award-info":[{"award-number":["Google focused research award,"]}],"id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1528025 and DMS-1521608"],"award-info":[{"award-number":["IIS-1528025 and DMS-1521608"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007633","name":"Korea Foundation for Advanced Studies","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100007633","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>Assembly-based tools provide a powerful modeling paradigm for non-expert shape designers. However, choosing a component from a large shape repository and aligning it to a partial assembly can become a daunting task. In this paper we describe novel neural network architectures for suggesting complementary components and their placement for an incomplete 3D part assembly. Unlike most existing techniques, our networks are trained on unlabeled data obtained from public online repositories, and do not rely on consistent part segmentations or labels. Absence of labels poses a challenge in indexing the database of parts for the retrieval. We address it by jointly training embedding and retrieval networks, where the first indexes parts by mapping them to a low-dimensional feature space, and the second maps partial assemblies to appropriate complements. The combinatorial nature of part arrangements poses another challenge, since the retrieval network is not a function: several complements can be appropriate for the same input. Thus, instead of predicting a single output, we train our network to predict a probability distribution over the space of part embeddings. This allows our method to deal with ambiguities and naturally enables a UI that seamlessly integrates user preferences into the design process. We demonstrate that our method can be used to design complex shapes with minimal or no user input. To evaluate our approach we develop a novel benchmark for component suggestion systems demonstrating significant improvement over state-of-the-art techniques.<\/jats:p>","DOI":"10.1145\/3130800.3130821","type":"journal-article","created":{"date-parts":[[2017,11,22]],"date-time":"2017-11-22T16:25:08Z","timestamp":1511367908000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":82,"title":["ComplementMe"],"prefix":"10.1145","volume":"36","author":[{"given":"Minhyuk","family":"Sung","sequence":"first","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Su","sequence":"additional","affiliation":[{"name":"Stanford University and University of California San Diego"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vladimir G.","family":"Kim","sequence":"additional","affiliation":[{"name":"Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Siddhartha","family":"Chaudhuri","sequence":"additional","affiliation":[{"name":"IIT Bombay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leonidas","family":"Guibas","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,11,20]]},"reference":[{"key":"e_1_2_2_2_1","volume-title":"ShapeNet: An Information-Rich 3D Model Repository. CoRR abs\/1512.03012","author":"Chang Angel X.","year":"2015","unstructured":"Angel X. Chang , Thomas A. Funkhouser , Leonidas J. Guibas , Pat Hanrahan , Qi-Xing Huang , Zimo Li , Silvio Savarese , Manolis Sawa , Shuran Song , Hao Su , Jianxiong Xiao , Li Yi , and Fisher Yu. 2015. ShapeNet: An Information-Rich 3D Model Repository. CoRR abs\/1512.03012 ( 2015 ). Angel X. Chang, Thomas A. Funkhouser, Leonidas J. Guibas, Pat Hanrahan, Qi-Xing Huang, Zimo Li, Silvio Savarese, Manolis Sawa, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, and Fisher Yu. 2015. ShapeNet: An Information-Rich 3D Model Repository. CoRR abs\/1512.03012 (2015)."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964921.1964930"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866158.1866205"},{"key":"e_1_2_2_5_1","volume-title":"Large Scale Online Learning of Image Similarity Through Ranking. JMLR","author":"Chechik Gal","year":"2010","unstructured":"Gal Chechik , Varun Sharma , Uri Shalit , and Samy Bengio . 2010. Large Scale Online Learning of Image Similarity Through Ranking. JMLR ( 2010 ). Gal Chechik, Varun Sharma, Uri Shalit, and Samy Bengio. 2010. Large Scale Online Learning of Image Similarity Through Ranking. JMLR (2010)."},{"key":"e_1_2_2_6_1","unstructured":"Christopher B. Choy Danfei Xu JunYoung Gwak Kevin Chen and Silvio Savarese. 2016. 3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction.  Christopher B. Choy Danfei Xu JunYoung Gwak Kevin Chen and Silvio Savarese. 2016. 3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction."},{"key":"e_1_2_2_7_1","volume-title":"A Point Set Generation Network for 3D Object Reconstruction from a Single Image. CVPR","author":"Fan Haoqiang","year":"2017","unstructured":"Haoqiang Fan , Hao Su , and Leonidas Guibas . 2017. A Point Set Generation Network for 3D Object Reconstruction from a Single Image. CVPR ( 2017 ). Haoqiang Fan, Hao Su, and Leonidas Guibas. 2017. A Point Set Generation Network for 3D Object Reconstruction from a Single Image. CVPR (2017)."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366154"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015775"},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"A. Garcia-Garcia F. Gomez-Donoso J. Garcia-Rodriguez S. Orts-Escolano M. Cazorla and J. Azorin-Lopez. 2016. PointNet: A 3D Convolutional Neural Network for real-time object class recognition. In IJCNN.  A. Garcia-Garcia F. Gomez-Donoso J. Garcia-Rodriguez S. Orts-Escolano M. Cazorla and J. Azorin-Lopez. 2016. PointNet: A 3D Convolutional Neural Network for real-time object class recognition. In IJCNN.","DOI":"10.1109\/IJCNN.2016.7727386"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Rohit Girdhar David F. Fouhey Mikel Rodriguez and Abhinav Gupta. 2016. Learning a Predictable and Generative Vector Representation for Objects.  Rohit Girdhar David F. Fouhey Mikel Rodriguez and Abhinav Gupta. 2016. Learning a Predictable and Generative Vector Representation for Objects.","DOI":"10.1007\/978-3-319-46466-4_29"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409098"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2009.03.010"},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Edward Grant Pushmeet Kohli and Marcel van Gerven. 2016. Deep Disentangled Representations for Volumetric Reconstruction.  Edward Grant Pushmeet Kohli and Marcel van Gerven. 2016. Deep Disentangled Representations for Volumetric Reconstruction.","DOI":"10.1007\/978-3-319-49409-8_22"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.100"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03175.x"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766914"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024159"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601111"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2015.10.002"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185551"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778839"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601117"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461933"},{"key":"e_1_2_2_25_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba . 2014 . Adam : A Method for Stochastic Optimization. CoRR ( 2014). Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. CoRR (2014)."},{"key":"e_1_2_2_26_1","unstructured":"Diederik P. Kingma Danilo J. Rezende Shakir Mohamed and Max Welling. 2014. Semi-supervised Learning with Deep Generative Models. In NIPS.   Diederik P. Kingma Danilo J. Rezende Shakir Mohamed and Max Welling. 2014. Semi-supervised Learning with Deep Generative Models. In NIPS."},{"key":"e_1_2_2_27_1","volume-title":"Using Locally Corresponding CAD Models for Dense 3D Reconstructions from a Single Image. CVPR","author":"Kong Chen","year":"2017","unstructured":"Chen Kong , Chen-Hsuan Lin , and Simon Lucey . 2017. Using Locally Corresponding CAD Models for Dense 3D Reconstructions from a Single Image. CVPR ( 2017 ). Chen Kong, Chen-Hsuan Lin, and Simon Lucey. 2017. Using Locally Corresponding CAD Models for Dense 3D Reconstructions from a Single Image. CVPR (2017)."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073637"},{"key":"e_1_2_2_29_1","unstructured":"Yangyan Li Angela Dai Leonidas Guibas and Matthias Nie\u00dfner. 2015. Database-Assisted Object Retrieval for Real-Time 3D Reconstruction. (2015).  Yangyan Li Angela Dai Leonidas Guibas and Matthias Nie\u00dfner. 2015. Database-Assisted Object Retrieval for Real-Time 3D Reconstruction. (2015)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2014.108"},{"key":"e_1_2_2_31_1","volume-title":"Conditional Generative Adversarial Nets. CoRR abs\/1411.1784","author":"Mirza Mehdi","year":"2014","unstructured":"Mehdi Mirza and Simon Osindero . 2014. Conditional Generative Adversarial Nets. CoRR abs\/1411.1784 ( 2014 ). Mehdi Mirza and Simon Osindero. 2014. Conditional Generative Adversarial Nets. CoRR abs\/1411.1784 (2014)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/571647.571648"},{"key":"e_1_2_2_33_1","volume-title":"Guibas","author":"Qi Charles Ruizhongtai","year":"2017","unstructured":"Charles Ruizhongtai Qi , Hao Su , Kaichun Mo , and Leonidas J . Guibas . 2017 . PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. CVPR ( 2017). Charles Ruizhongtai Qi, Hao Su, Kaichun Mo, and Leonidas J. Guibas. 2017. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. CVPR (2017)."},{"key":"e_1_2_2_34_1","unstructured":"C. R. Qi H. Su M. Nie\u00c3&sect;ner A. Dai M. Yan and L. J. Guibas. 2016. Volumetric and Multi-view CNNs for Object Classification on 3D Data. In CVPR.  C. R. Qi H. Su M. Nie\u00c3&sect;ner A. Dai M. Yan and L. J. Guibas. 2016. Volumetric and Multi-view CNNs for Object Classification on 3D Data. In CVPR."},{"key":"e_1_2_2_35_1","volume-title":"Ali Osman Ulusoy, and Andreas Geiger","author":"Riegler Gernot","year":"2017","unstructured":"Gernot Riegler , Ali Osman Ulusoy, and Andreas Geiger . 2017 . OctNet: Learning Deep 3D Representations at High Resolutions. CVPR ( 2017). Gernot Riegler, Ali Osman Ulusoy, and Andreas Geiger. 2017. OctNet: Learning Deep 3D Representations at High Resolutions. CVPR (2017)."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661288"},{"key":"e_1_2_2_37_1","doi-asserted-by":"crossref","unstructured":"Abhishek Sharma Oliver Grau and Mario Fritz. 2016. VConv-DAE: Deep Volumetric Shape Learning Without Object Labels.  Abhishek Sharma Oliver Grau and Mario Fritz. 2016. VConv-DAE: Deep Volumetric Shape Learning Without Object Labels.","DOI":"10.1007\/978-3-319-49409-8_20"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366199"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024160"},{"key":"e_1_2_2_40_1","unstructured":"Kihyuk Sohn Xinchen Yan and Honglak Lee. 2015. Learning Structured Output Representation Using Deep Conditional Generative Models. In NIPS.   Kihyuk Sohn Xinchen Yan and Honglak Lee. 2015. Learning Structured Output Representation Using Deep Conditional Generative Models. In NIPS."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818071"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.114"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818094"},{"key":"e_1_2_2_44_1","volume-title":"https:\/\/3dwarehouse.sketchup.com\/","author":"Warehouse D","year":"2017","unstructured":"Trimble. 2017. 3 D Warehouse . ( 2017 ). https:\/\/3dwarehouse.sketchup.com\/ Trimble. 2017. 3D Warehouse. (2017). https:\/\/3dwarehouse.sketchup.com\/"},{"key":"e_1_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Shubham Tulsiani Tinghui Zhou Alexei A. Efros and Jitendra Malik. 2017. Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistency. In CVPR.  Shubham Tulsiani Tinghui Zhou Alexei A. Efros and Jitendra Malik. 2017. Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistency. In CVPR.","DOI":"10.1109\/CVPR.2017.30"},{"key":"e_1_2_2_46_1","unstructured":"Laurens van der Maaten. 2009. Learning a Parametric Embedding by Preserving Local Structure. In AISTATS.  Laurens van der Maaten. 2009. Learning a Parametric Embedding by Preserving Local Structure. In AISTATS."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461924"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366184"},{"key":"e_1_2_2_49_1","volume-title":"Freeman","author":"Wu Jiajun","year":"2016","unstructured":"Jiajun Wu , Tianfan Xue , Joseph J. Lim , Yuandong Tian , Joshua B. Tenenbaum , Antonio Torralba , and William T . Freeman . 2016 a. Single Image 3D Interpreter Network . Jiajun Wu, Tianfan Xue, Joseph J. Lim, Yuandong Tian, Joshua B. Tenenbaum, Antonio Torralba, and William T. Freeman. 2016a. Single Image 3D Interpreter Network."},{"key":"e_1_2_2_50_1","unstructured":"Jiajun Wu Chengkai Zhang Tianfan Xue William T Freeman and Joshua B Tenenbaum. 2016b. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. In NIPS.   Jiajun Wu Chengkai Zhang Tianfan Xue William T Freeman and Joshua B Tenenbaum. 2016b. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. In NIPS."},{"key":"e_1_2_2_51_1","volume-title":"3D ShapeNets for 2.5D Object Recognition and Next-Best-View Prediction. CVPR","author":"Wu Zhirong","year":"2015","unstructured":"Zhirong Wu , Shuran Song , Aditya Khosla , Xiaoou Tang , and Jianxiong Xiao . 2015a. 3D ShapeNets for 2.5D Object Recognition and Next-Best-View Prediction. CVPR ( 2015 ). Zhirong Wu, Shuran Song, Aditya Khosla, Xiaoou Tang, and Jianxiong Xiao. 2015a. 3D ShapeNets for 2.5D Object Recognition and Next-Best-View Prediction. CVPR (2015)."},{"key":"e_1_2_2_52_1","doi-asserted-by":"crossref","unstructured":"Zhirong Wu S. Song A. Khosla Fisher Yu Linguang Zhang Xiaoou Tang and J. Xiao. 2015b. 3D ShapeNets: A deep representation for volumetric shapes. In CVPR.  Zhirong Wu S. Song A. Khosla Fisher Yu Linguang Zhang Xiaoou Tang and J. Xiao. 2015b. 3D ShapeNets: A deep representation for volumetric shapes. In CVPR.","DOI":"10.1109\/CVPR.2015.7298801"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12434"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185553"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073652"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980238"},{"key":"e_1_2_2_57_1","volume-title":"Mitra","author":"Zheng Youyi","year":"2014","unstructured":"Youyi Zheng , Daniel Cohen-Or , Melinos Averkiou , and Niloy J . Mitra . 2014 . Recurring part arrangements in shape collections. (2014). Youyi Zheng, Daniel Cohen-Or, Melinos Averkiou, and Niloy J. Mitra. 2014. Recurring part arrangements in shape collections. (2014)."},{"key":"e_1_2_2_58_1","volume-title":"Mitra","author":"Zheng Youyi","year":"2013","unstructured":"Youyi Zheng , Daniel Cohen-Or , and Niloy J . Mitra . 2013 . Smart Variations : Functional Substructures for Part Compatibility. Eurographics ( 2013). Youyi Zheng, Daniel Cohen-Or, and Niloy J. Mitra. 2013. Smart Variations: Functional Substructures for Part Compatibility. Eurographics (2013)."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130821","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130800.3130821","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130800.3130821","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:17Z","timestamp":1750213577000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130821"}},"subtitle":["weakly-supervised component suggestions for 3D modeling"],"short-title":[],"issued":{"date-parts":[[2017,11,20]]},"references-count":57,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3130800.3130821"],"URL":"https:\/\/doi.org\/10.1145\/3130800.3130821","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,20]]},"assertion":[{"value":"2017-11-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}