{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T18:56:04Z","timestamp":1785610564789,"version":"3.56.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ERC Starting Grant D3","award":["ERC-2016-STG 714221"],"award-info":[{"award-number":["ERC-2016-STG 714221"]}]},{"name":"ERC Grant SmartGeometry","award":["335373"],"award-info":[{"award-number":["335373"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>\n            We present a sketch-based CAD modeling system, where users create objects incrementally by sketching the desired shape edits, which our system automatically translates to CAD operations. Our approach is motivated by the close similarities between the steps industrial designers follow to draw 3D shapes, and the operations CAD modeling systems offer to create similar shapes. To overcome the strong ambiguity with parsing 2D sketches, we observe that in a sketching sequence, each step makes sense and can be interpreted in the\n            <jats:italic>context<\/jats:italic>\n            of what has been drawn before. In our system, this context corresponds to a partial CAD model, inferred in the previous steps, which we feed along with the input sketch to a deep neural network in charge of interpreting how the model should be modified by that sketch. Our deep network architecture then recognizes the intended CAD operation and segments the sketch accordingly, such that a subsequent optimization estimates the parameters of the operation that best fit the segmented sketch strokes. Since there exists no datasets of paired sketching and CAD modeling sequences, we train our system by generating synthetic sequences of CAD operations that we render as line drawings. We present a proof of concept realization of our algorithm supporting four frequently used CAD operations. Using our system, participants are able to quickly model a large and diverse set of objects, demonstrating Sketch2CAD to be an alternate way of interacting with current CAD modeling systems.\n          <\/jats:p>","DOI":"10.1145\/3414685.3417807","type":"journal-article","created":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T21:51:05Z","timestamp":1606513865000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":62,"title":["Sketch2CAD"],"prefix":"10.1145","volume":"39","author":[{"given":"Changjian","family":"Li","sequence":"first","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Pan","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adrien","family":"Bousseau","sequence":"additional","affiliation":[{"name":"Inria, Universit\u00e9 C\u00f4te d'Azur"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niloy J.","family":"Mitra","sequence":"additional","affiliation":[{"name":"University College London and Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Autodesk. 2019a. 3ds Max. https:\/\/www.autodesk.com\/products\/3ds-max\/overview  Autodesk. 2019a. 3ds Max. https:\/\/www.autodesk.com\/products\/3ds-max\/overview"},{"key":"e_1_2_2_2_1","unstructured":"Autodesk. 2019b. Maya. https:\/\/www.autodesk.com\/products\/maya\/overview  Autodesk. 2019b. Maya. https:\/\/www.autodesk.com\/products\/maya\/overview"},{"key":"e_1_2_2_3_1","unstructured":"Autodesk. 2019. TinkerCAD. https:\/\/www.tinkercad.com\/  Autodesk. 2019. TinkerCAD. https:\/\/www.tinkercad.com\/"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00272"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1449715.1449740"},{"key":"e_1_2_2_6_1","volume-title":"Tom Landwehr, Juncheng Liu, et al.","author":"Bonnici Alexandra","year":"2019","unstructured":"Alexandra Bonnici , Alican Akman , Gabriel Calleja , Kenneth P Camilleri , Patrick Fehling , Alfredo Ferreira , Florian Hermuth , Johann Habakuk Israel , Tom Landwehr, Juncheng Liu, et al. 2019 . Sketch-based interaction and modeling: where do we stand? AI EDAM ( 2019), 1--19. Alexandra Bonnici, Alican Akman, Gabriel Calleja, Kenneth P Camilleri, Patrick Fehling, Alfredo Ferreira, Florian Hermuth, Johann Habakuk Israel, Tom Landwehr, Juncheng Liu, et al. 2019. Sketch-based interaction and modeling: where do we stand? AI EDAM (2019), 1--19."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2012.10.013"},{"key":"e_1_2_2_8_1","volume-title":"Article 126 (July","author":"Paoli Chris De","year":"2015","unstructured":"Chris De Paoli and Karan Singh . 2015. SecondSkin: Sketch-Based Construction of Layered 3D Models. ACM Transactions on Graphics (Proc. SIGGRAPH) 34, 4 , Article 126 (July 2015 ), 10 pages. Chris De Paoli and Karan Singh. 2015. SecondSkin: Sketch-Based Construction of Layered 3D Models. ACM Transactions on Graphics (Proc. SIGGRAPH) 34, 4, Article 126 (July 2015), 10 pages."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3203197"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964961"},{"key":"e_1_2_2_11_1","volume-title":"Yewen Pu, Andrew Spielberg, Adriana Schulz, Daniela Rus, Armando Solar-Lezama, and Wojciech Matusik.","author":"Du Tao","year":"2018","unstructured":"Tao Du , Jeevana Priya Inala , Yewen Pu, Andrew Spielberg, Adriana Schulz, Daniela Rus, Armando Solar-Lezama, and Wojciech Matusik. 2018 . InverseCSG: Automatic Conversion of 3D Models to CSG Trees. ACM Transactions on Graphics (Proc. SIGGRAPH Asia 37, 6 (2018). Tao Du, Jeevana Priya Inala, Yewen Pu, Andrew Spielberg, Adriana Schulz, Daniela Rus, Armando Solar-Lezama, and Wojciech Matusik. 2018. InverseCSG: Automatic Conversion of 3D Models to CSG Trees. ACM Transactions on Graphics (Proc. SIGGRAPH Asia 37, 6 (2018)."},{"key":"e_1_2_2_12_1","volume-title":"Sketching: Drawing Techniques for Product Designers","author":"Eissen Koos","year":"2008","unstructured":"Koos Eissen and Roselien Steur . 2008 . Sketching: Drawing Techniques for Product Designers . Bis Publishers . Koos Eissen and Roselien Steur. 2008. Sketching: Drawing Techniques for Product Designers. Bis Publishers."},{"key":"e_1_2_2_13_1","volume-title":"Sketching: The Basics. BIS.","author":"Eissen K.","year":"2011","unstructured":"K. Eissen and R. Steur . 2011 . Sketching: The Basics. BIS. K. Eissen and R. Steur. 2011. Sketching: The Basics. BIS."},{"key":"e_1_2_2_14_1","unstructured":"Kevin Ellis Daniel Ritchie Armando Solar-Lezama and Josh Tenenbaum. 2018. Learning to infer graphics programs from hand-drawn images. In Advances in neural information processing systems. 6059--6068.  Kevin Ellis Daniel Ritchie Armando Solar-Lezama and Josh Tenenbaum. 2018. Learning to infer graphics programs from hand-drawn images. In Advances in neural information processing systems. 6059--6068."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299028"},{"key":"e_1_2_2_16_1","volume-title":"Structured Annotations for 2D-to-3D Modeling. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 28, 5","author":"Gingold Yotam","year":"2009","unstructured":"Yotam Gingold , Takeo Igarashi , and Denis Zorin . 2009. Structured Annotations for 2D-to-3D Modeling. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 28, 5 ( 2009 ). Yotam Gingold, Takeo Igarashi, and Denis Zorin. 2009. Structured Annotations for 2D-to-3D Modeling. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 28, 5 (2009)."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356533"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467771"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311602"},{"key":"e_1_2_2_20_1","volume-title":"Proceedings of the Rapid Product Development Event RDP.","author":"Jorge Joaquim A","year":"2003","unstructured":"Joaquim A Jorge , Nelson F Silva , and Tiago D Cardoso . 2003 . GIDeS++: A Rapid Prototyping Tool for Mould Design . In Proceedings of the Rapid Product Development Event RDP. Joaquim A Jorge, Nelson F Silva, and Tiago D Cardoso. 2003. GIDeS++: A Rapid Prototyping Tool for Mould Design. In Proceedings of the Rapid Product Development Event RDP."},{"key":"e_1_2_2_21_1","volume-title":"Proc. Sketch-Based Interfaces and Modeling.","author":"Lau Manfred","year":"2010","unstructured":"Manfred Lau , Greg Saul , Jun Mitani , and Takeo Igarashi . 2010 . Modeling-in-context: user design of complementary objects with a single photo . In Proc. Sketch-Based Interfaces and Modeling. Manfred Lau, Greg Saul, Jun Mitani, and Takeo Igarashi. 2010. Modeling-in-context: user design of complementary objects with a single photo. In Proc. Sketch-Based Interfaces and Modeling."},{"key":"e_1_2_2_22_1","volume-title":"Robust flow-guided neural prediction for sketch-based freeform surface modeling. ACM Transaction on Graphics (Proc. SIGGRAPH Asia)","author":"Li Changjian","year":"2018","unstructured":"Changjian Li , Hao Pan , Yang Liu , Xin Tong , Alla Sheffer , and Wenping Wang . 2018. Robust flow-guided neural prediction for sketch-based freeform surface modeling. ACM Transaction on Graphics (Proc. SIGGRAPH Asia) ( 2018 ), 238. Changjian Li, Hao Pan, Yang Liu, Xin Tong, Alla Sheffer, and Wenping Wang. 2018. Robust flow-guided neural prediction for sketch-based freeform surface modeling. ACM Transaction on Graphics (Proc. SIGGRAPH Asia) (2018), 238."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126611"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-4485(95)00081-X"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2017.00018"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00100"},{"key":"e_1_2_2_27_1","volume-title":"Proceedings of the 1st Ibero-American Symposium in Computer Graphics SIACG. 109--117","author":"Naya Fernando","year":"2002","unstructured":"Fernando Naya , Joaquim Jorge , Juli\u00e1n Conesa , Manuel Contero , and Jos\u00e9 Mar\u00eda Gomis . 2002 . Direct modeling: from sketches to 3D models . In Proceedings of the 1st Ibero-American Symposium in Computer Graphics SIACG. 109--117 . Fernando Naya, Joaquim Jorge, Juli\u00e1n Conesa, Manuel Contero, and Jos\u00e9 Mar\u00eda Gomis. 2002. Direct modeling: from sketches to 3D models. In Proceedings of the 1st Ibero-American Symposium in Computer Graphics SIACG. 109--117."},{"key":"e_1_2_2_28_1","volume-title":"Article 41","author":"Nealen Andrew","year":"2007","unstructured":"Andrew Nealen , Takeo Igarashi , Olga Sorkine , and Marc Alexa . 2007. FiberMesh: designing freeform surfaces with 3D curves. ACM Transactions on Graphics (Proc. SIGGRAPH) 26 , Article 41 ( 2007 ). Issue 3. Andrew Nealen, Takeo Igarashi, Olga Sorkine, and Marc Alexa. 2007. FiberMesh: designing freeform surfaces with 3D curves. ACM Transactions on Graphics (Proc. SIGGRAPH) 26, Article 41 (2007). Issue 3."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925951"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024216"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201311"},{"key":"e_1_2_2_32_1","unstructured":"A. Pipes. 2007. Drawing for designers. Laurence King.  A. Pipes. 2007. Drawing for designers. Laurence King."},{"key":"e_1_2_2_33_1","volume-title":"Article 109","author":"Rivers Alec","year":"2010","unstructured":"Alec Rivers , Fr\u00e9do Durand , and Takeo Igarashi . 2010. 3D Modeling with Silhouettes. ACM Transactions on Graphics (Proc. SIGGRAPH) 29, 4 , Article 109 ( 2010 ), 8 pages. Alec Rivers, Fr\u00e9do Durand, and Takeo Igarashi. 2010. 3D Modeling with Silhouettes. ACM Transactions on Graphics (Proc. SIGGRAPH) 29, 4, Article 109 (2010), 8 pages."},{"key":"e_1_2_2_34_1","unstructured":"Robert McNeel & Associates. 2019. Rhinoceros. https:\/\/www.rhino3d.com\/  Robert McNeel & Associates. 2019. Rhinoceros. https:\/\/www.rhino3d.com\/"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1661412.1618495"},{"key":"e_1_2_2_36_1","volume-title":"CSGNet: Neural Shape Parser for Constructive Solid Geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Sharma Gopal","year":"2018","unstructured":"Gopal Sharma , Rishabh Goyal , Difan Liu , Evangelos Kalogerakis , and Subhransu Maji . 2018 . CSGNet: Neural Shape Parser for Constructive Solid Geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Gopal Sharma, Rishabh Goyal, Difan Liu, Evangelos Kalogerakis, and Subhransu Maji. 2018. CSGNet: Neural Shape Parser for Constructive Solid Geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12044"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3203186"},{"key":"e_1_2_2_39_1","unstructured":"The CGAL Project. 2020. CGAL User and Reference Manual (5.0.2 ed.). CGAL Editorial Board. https:\/\/doc.cgal.org\/5.0.2\/Manual\/packages.html  The CGAL Project. 2020. CGAL User and Reference Manual (5.0.2 ed.). CGAL Editorial Board. https:\/\/doc.cgal.org\/5.0.2\/Manual\/packages.html"},{"key":"e_1_2_2_40_1","volume-title":"International Conference on Learning Representations.","author":"Tian Yonglong","year":"2019","unstructured":"Yonglong Tian , Andrew Luo , Xingyuan Sun , Kevin Ellis , William T. Freeman , Joshua B. Tenenbaum , and Jiajun Wu . 2019 . Learning to Infer and Execute 3D Shape Programs . In International Conference on Learning Representations. Yonglong Tian, Andrew Luo, Xingyuan Sun, Kevin Ellis, William T. Freeman, Joshua B. Tenenbaum, and Jiajun Wu. 2019. Learning to Infer and Execute 3D Shape Programs. In International Conference on Learning Representations."},{"key":"e_1_2_2_41_1","unstructured":"Trimble. 2019. SketchUp. https:\/\/www.sketchup.com\/  Trimble. 2019. SketchUp. https:\/\/www.sketchup.com\/"},{"key":"e_1_2_2_42_1","volume-title":"Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Wang Yingze","year":"2009","unstructured":"Yingze Wang , Yu Chen , Jianzhuang Liu , and Xiaoou Tang . 2009 . 3D reconstruction of curved objects from single 2D line drawings . In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Yingze Wang, Yu Chen, Jianzhuang Liu, and Xiaoou Tang. 2009. 3D reconstruction of curved objects from single 2D line drawings. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601128"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2860016"},{"key":"e_1_2_2_45_1","volume-title":"Proceedings of SIGGRAPH (Computer Graphics Proceedings, Annual Conference Series). 163--170","author":"Zeleznik Robert C.","unstructured":"Robert C. Zeleznik , Kenneth P. Herndon , and John F. Hughes . 1996. SKETCH: An Interface for Sketching 3D Scenes . In Proceedings of SIGGRAPH (Computer Graphics Proceedings, Annual Conference Series). 163--170 . Robert C. Zeleznik, Kenneth P. Herndon, and John F. Hughes. 1996. SKETCH: An Interface for Sketching 3D Scenes. In Proceedings of SIGGRAPH (Computer Graphics Proceedings, Annual Conference Series). 163--170."},{"key":"e_1_2_2_46_1","volume-title":"SMART CANVAS : Context-inferred Interpretation of Sketches for Preparatory Design Studies.","author":"Zheng Youyi","year":"2016","unstructured":"Youyi Zheng , Han Liu , Julie Dorsey , and Niloy Mitra . 2016 . SMART CANVAS : Context-inferred Interpretation of Sketches for Preparatory Design Studies. (2016). Youyi Zheng, Han Liu, Julie Dorsey, and Niloy Mitra. 2016. SMART CANVAS : Context-inferred Interpretation of Sketches for Preparatory Design Studies. (2016)."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417807","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3414685.3417807","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:14Z","timestamp":1750197794000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417807"}},"subtitle":["sequential CAD modeling by sketching in context"],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":46,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3414685.3417807"],"URL":"https:\/\/doi.org\/10.1145\/3414685.3417807","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,27]]},"assertion":[{"value":"2020-11-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}