{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,2]],"date-time":"2026-08-02T19:35:10Z","timestamp":1785699310263,"version":"3.56.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T00:00:00Z","timestamp":1656633600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["71422, 335373"],"award-info":[{"award-number":["71422, 335373"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["956585"],"award-info":[{"award-number":["956585"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:p>CAD modeling, despite being the industry-standard, remains restricted to usage by skilled practitioners due to two key barriers. First, the user must be able to mentally parse a final shape into a valid sequence of supported CAD commands; and second, the user must be sufficiently conversant with CAD software packages to be able to execute the corresponding CAD commands. As a step towards addressing both these challenges, we present Free2CAD wherein the user can simply sketch the final shape and our system parses the input strokes into a sequence of commands expressed in a simplified CAD language. When executed, these commands reproduce the sketched object. Technically, we cast sketch-based CAD modeling as a sequence-to-sequence translation problem, for which we leverage the powerful Transformers neural network architecture. Given the sequence of pen strokes as input, we introduce the new task of grouping strokes that correspond to individual CAD operations. We combine stroke grouping with geometric fitting of the operation parameters, such that intermediate groups are geometrically corrected before being reused, as context, for subsequent steps in the sequence inference. Although trained on synthetically-generated data, we demonstrate that Free2CAD generalizes to sketches created from real-world CAD models as well as to sketches drawn by novice users.<\/jats:p>\n          <jats:p>\n            <jats:italic>Code and data are at https:\/\/github.com\/Enigma-li\/Free2CAD.<\/jats:italic>\n          <\/jats:p>","DOI":"10.1145\/3528223.3530133","type":"journal-article","created":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T21:06:27Z","timestamp":1658523987000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":67,"title":["Free2CAD"],"prefix":"10.1145","volume":"41","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0448-4957","authenticated-orcid":false,"given":"Changjian","family":"Li","sequence":"first","affiliation":[{"name":"Universit\u00e9 C\u00f4te d'Azur, France and University College London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3628-9777","authenticated-orcid":false,"given":"Hao","family":"Pan","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8003-9575","authenticated-orcid":false,"given":"Adrien","family":"Bousseau","sequence":"additional","affiliation":[{"name":"Universit\u00e9 C\u00f4te d'Azur, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niloy J.","family":"Mitra","sequence":"additional","affiliation":[{"name":"University College London, United Kingdom and Adobe Research, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Autodesk. 2019. TinkerCAD. https:\/\/www.tinkercad.com\/"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1449715.1449740"},{"key":"e_1_2_2_3_1","volume-title":"Theory-Based Course. In Proc. of the ACM SIGCHI Conference on Human Factors in Computing Systems. 183--190","author":"Bhavnani Suresh K.","year":"1999","unstructured":"Suresh K. Bhavnani, Bonnie E. John, and Ulrich Flemming. 1999. The Strategic Use of CAD: An Empirically Inspired, Theory-Based Course. In Proc. of the ACM SIGCHI Conference on Human Factors in Computing Systems. 183--190."},{"key":"e_1_2_2_4_1","volume-title":"Tom Landwehr, Juncheng Liu, et al.","author":"Bonnici Alexandra","year":"2019","unstructured":"Alexandra Bonnici, Alican Akman, Gabriel Calleja, Kenneth P Camilleri, Patrick Fehling, Alfredo Ferreira, Florian Hermuth, Johann Habakuk Israel, Tom Landwehr, Juncheng Liu, et al. 2019. Sketch-based interaction and modeling: where do we stand? Artificial intelligence for engineering design analysis and manufacturing (2019), 1--19."},{"key":"e_1_2_2_5_1","doi-asserted-by":"crossref","unstructured":"Yu Chen Jianzhuang Liu and Xiaoou Tang. 2007. A Divide-and-Conquer Approach to 3D Object Reconstruction from Line Drawings. In ICCV.","DOI":"10.1109\/ICCV.2007.4409059"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10798-006-9015-z"},{"key":"e_1_2_2_7_1","volume-title":"Keys to drawing","author":"Dodson Bert","unstructured":"Bert Dodson. 1990. Keys to drawing. Penguin."},{"key":"e_1_2_2_8_1","volume-title":"Yewen Pu, Andrew Spielberg, Adriana Schulz, Daniela Rus, Armando Solar-Lezama, and Wojciech Matusik.","author":"Du Tao","year":"2018","unstructured":"Tao Du, Jeevana Priya Inala, Yewen Pu, Andrew Spielberg, Adriana Schulz, Daniela Rus, Armando Solar-Lezama, and Wojciech Matusik. 2018. InverseCSG: Automatic Conversion of 3D Models to CSG Trees. ACM Transactions on Graphics (Proc. SIGGRAPH Asia 37, 6 (2018)."},{"key":"e_1_2_2_9_1","volume-title":"Drawing on the Right Side of the Brain","author":"Edwards Betty","unstructured":"Betty Edwards. 1979. Drawing on the Right Side of the Brain. Penguin."},{"key":"e_1_2_2_10_1","volume-title":"Write","author":"Ellis Kevin","unstructured":"Kevin Ellis, Maxwell Nye, Yewen Pu, Felix Sosa, Josh Tenenbaum, and Armando Solar-Lezama. 2019. Write, Execute, Assess: Program Synthesis with a REPL. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 32."},{"key":"e_1_2_2_11_1","unstructured":"Kevin Ellis Daniel Ritchie Armando Solar-Lezama and Josh Tenenbaum. 2018. Learning to infer graphics programs from hand-drawn images. In Advances in neural information processing systems. 6059--6068."},{"key":"e_1_2_2_12_1","volume-title":"Computer-aided design as language. Advances in Neural Information Processing Systems 34","author":"Ganin Yaroslav","year":"2021","unstructured":"Yaroslav Ganin, Sergey Bartunov, Yujia Li, Ethan Keller, and Stefano Saliceti. 2021. Computer-aided design as language. Advances in Neural Information Processing Systems 34 (2021)."},{"key":"e_1_2_2_13_1","volume-title":"Structured Annotations for 2D-to-3D Modeling. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 28, 5","author":"Gingold Yotam","year":"2009","unstructured":"Yotam Gingold, Takeo Igarashi, and Denis Zorin. 2009. Structured Annotations for 2D-to-3D Modeling. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 28, 5 (2009)."},{"key":"e_1_2_2_14_1","volume-title":"Lifting Freehand Concept Sketches into 3D. ACM Transactions on Graphics","author":"Gryaditskaya Yulia","year":"2020","unstructured":"Yulia Gryaditskaya, Felix H\u00e4hnlein, Chenxi Liu, Alla Sheffer, and Adrien Bousseau. 2020. Lifting Freehand Concept Sketches into 3D. ACM Transactions on Graphics (2020)."},{"key":"e_1_2_2_15_1","volume-title":"Sylvia Pont, Fredo Durand, and Adrien Bousseau.","author":"Gryaditskaya Yulia","year":"2019","unstructured":"Yulia Gryaditskaya, Mark Sypesteyn, Jan Willem Hoftijzer, Sylvia Pont, Fredo Durand, and Adrien Bousseau. 2019. OpenSketch: A Richly-Annotated Dataset of Product Design Sketches. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) (2019)."},{"key":"e_1_2_2_16_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Ha David","year":"2018","unstructured":"David Ha and Douglas Eck. 2018. A Neural Representation of Sketch Drawings. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_2_17_1","volume-title":"Girshick","author":"He Kaiming","year":"2021","unstructured":"Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Doll\u00e1r, and Ross B. Girshick. 2021. Masked Autoencoders Are Scalable Vision Learners. CoRR abs\/2111.06377 (2021)."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347925"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467771"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417812"},{"key":"e_1_2_2_21_1","volume-title":"Proceedings of the Rapid Product Development Event RDP.","author":"Jorge Joaquim A","year":"2003","unstructured":"Joaquim A Jorge, Nelson F Silva, and Tiago D Cardoso. 2003. GIDeS++: A Rapid Prototyping Tool for Mould Design. In Proceedings of the Rapid Product Development Event RDP."},{"key":"e_1_2_2_22_1","volume-title":"Advances in Neural Information Processing Systems (NeurIPS)","volume":"33","author":"Kania Kacper","year":"2020","unstructured":"Kacper Kania, Maciej Zieba, and Tomasz Kajdanowicz. 2020. UCSG-NET- Unsupervised Discovering of Constructive Solid Geometry Tree. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 33."},{"key":"e_1_2_2_23_1","volume-title":"Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR).","author":"Diederik","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_2_24_1","volume-title":"ABC: A Big CAD Model Dataset For Geometric Deep Learning. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Koch Sebastian","year":"2019","unstructured":"Sebastian Koch, Albert Matveev, Zhongshi Jiang, Francis Williams, Alexey Artemov, Evgeny Burnaev, Marc Alexa, Denis Zorin, and Daniele Panozzo. 2019. ABC: A Big CAD Model Dataset For Geometric Deep Learning. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_25_1","first-page":"1","article-title":"Sketch2cad: Sequential cad modeling by sketching in context. ACM Transactions on Graphics (Proc","volume":"39","author":"Li Changjian","year":"2020","unstructured":"Changjian Li, Hao Pan, Adrien Bousseau, and Niloy J Mitra. 2020. Sketch2cad: Sequential cad modeling by sketching in context. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 39, 6 (2020), 1--14.","journal-title":"SIGGRAPH Asia)"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073632"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01237-3_36"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2018.2884192"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-4485(95)00081-X"},{"key":"e_1_2_2_30_1","volume-title":"Scheduled sampling for transformers. arXiv preprint arXiv:1906.07651","author":"Mihaylova Tsvetomila","year":"2019","unstructured":"Tsvetomila Mihaylova and Andr\u00e9 FT Martins. 2019. Scheduled sampling for transformers. arXiv preprint arXiv:1906.07651 (2019)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236794"},{"key":"e_1_2_2_32_1","volume-title":"Interactive Sketching of Urban Procedural Models. ACM Transactions on Graphics (SIGGRAPH Conference Proceedings)","author":"Nishida Gen","year":"2016","unstructured":"Gen Nishida, Ignacio Garcia-Dorado, Daniel G. Aliaga, Bedrich Benes, and Adrien Bousseau. 2016. Interactive Sketching of Urban Procedural Models. ACM Transactions on Graphics (SIGGRAPH Conference Proceedings) (2016)."},{"key":"e_1_2_2_33_1","volume-title":"Sketch-based surface design using malleable curve networks. Comput. Graph. Forum 36, 8","author":"Orbay G\u00fcNay","year":"2012","unstructured":"G\u00fcNay Orbay and Levent Burak Kara. 2012. Sketch-based surface design using malleable curve networks. Comput. Graph. Forum 36, 8 (2012)."},{"key":"e_1_2_2_34_1","volume-title":"Paul Guerrero, Tom Kelly, Niloy Mitra, Leonidas Guibas, and Peter Wonka.","author":"Para Wamiq Reyaz","year":"2021","unstructured":"Wamiq Reyaz Para, Shariq Farooq Bhat, Paul Guerrero, Tom Kelly, Niloy Mitra, Leonidas Guibas, and Peter Wonka. 2021. SketchGen: Generating Constrained CAD Sketches. arXiv:2106.02711 [cs.LG]"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2929804"},{"key":"e_1_2_2_36_1","volume-title":"Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Ferraz Ribeiro Leo Sampaio","year":"2020","unstructured":"Leo Sampaio Ferraz Ribeiro, Tu Bui, John Collomosse, and Moacir Ponti. 2020. Sketch-former: Transformer-based representation for sketched structure. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_37_1","volume-title":"ACM transactions on graphics (TOG)","author":"Schmidt Ryan","unstructured":"Ryan Schmidt, Azam Khan, Karan Singh, and Gord Kurtenbach. 2009. Analytic drawing of 3D scaffolds. In ACM transactions on graphics (TOG), Vol. 28. 149."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2898351"},{"key":"e_1_2_2_39_1","volume-title":"Vitruvion: A Generative Model of Parametric CAD Sketches. arXiv preprint arXiv:2109.14124","author":"Seff Ari","year":"2021","unstructured":"Ari Seff, Wenda Zhou, Nick Richardson, and Ryan P Adams. 2021. Vitruvion: A Generative Model of Parametric CAD Sketches. arXiv preprint arXiv:2109.14124 (2021)."},{"key":"e_1_2_2_40_1","volume-title":"Mitra","author":"Shao Tianjia","year":"2013","unstructured":"Tianjia Shao, Wilmot Li, Kun Zhou, Weiwei Xu, Baining Guo, and Niloy J. Mitra. 2013. Interpreting Concept Sketches. ACM Transactions on Graphics (Proc. SIGGRAPH) 32, 4 (2013), 10 pages."},{"key":"e_1_2_2_41_1","unstructured":"Shapr3D. 2016. Shapr3D. https:\/\/www.shapr3d.com\/"},{"key":"e_1_2_2_42_1","volume-title":"CSGNet: Neural Shape Parser for Constructive Solid Geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Sharma Gopal","year":"2018","unstructured":"Gopal Sharma, Rishabh Goyal, Difan Liu, Evangelos Kalogerakis, and Subhransu Maji. 2018. CSGNet: Neural Shape Parser for Constructive Solid Geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_43_1","volume-title":"Computer graphics forum","author":"Shtof Alex","unstructured":"Alex Shtof, Alexander Agathos, Yotam Gingold, Ariel Shamir, and Daniel Cohen-Or. 2013. Geosemantic snapping for sketch-based modeling. In Computer graphics forum, Vol. 32. Wiley Online Library, 245--253."},{"key":"e_1_2_2_44_1","volume-title":"Sketching: The Basics. BIS.","author":"Steur Roselien","year":"2011","unstructured":"Roselien Steur. 2011. Sketching: The Basics. BIS."},{"key":"e_1_2_2_45_1","volume-title":"International Conference on Learning Representations.","author":"Tian Yonglong","year":"2019","unstructured":"Yonglong Tian, Andrew Luo, Xingyuan Sun, Kevin Ellis, William T. Freeman, Joshua B. Tenenbaum, and Jiajun Wu. 2019. Learning to Infer and Execute 3D Shape Programs. In International Conference on Learning Representations."},{"key":"e_1_2_2_46_1","unstructured":"Trimble. 2019. SketchUp. https:\/\/www.sketchup.com\/"},{"key":"e_1_2_2_47_1","volume-title":"\u0141 ukasz Kaiser, and Illia Polosukhin","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141 ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, Vol. 30."},{"key":"e_1_2_2_48_1","volume-title":"Advances in Neural Information Processing Systems","volume":"28","author":"Vinyals Oriol","year":"2015","unstructured":"Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015. Pointer Networks. In Advances in Neural Information Processing Systems, Vol. 28. Curran Associates, Inc."},{"key":"e_1_2_2_49_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3450626.3459819","article-title":"Tracing versus freehand for evaluating computer-generated drawings","volume":"40","author":"Wang Zeyu","year":"2021","unstructured":"Zeyu Wang, Sherry Qiu, Nicole Feng, Holly Rushmeier, Leonard McMillan, and Julie Dorsey. 2021. Tracing versus freehand for evaluating computer-generated drawings. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1--12.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459818"},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Q. Wu K. Xu and J. Wang. 2018. Constructing 3D CSG Models from 3D Raw Point Clouds. Computer Graphics Forum 37 5 (2018).","DOI":"10.1111\/cgf.13504"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00670"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601128"},{"key":"e_1_2_2_54_1","unstructured":"Xianghao Xu Wenzhe Peng Chin-Yi Cheng Karl D. D. Willis and Daniel Ritchie. 2021. Inferring CAD Modeling Sequences Using Zone Graphs. In CVPR."},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450284"},{"key":"e_1_2_2_56_1","unstructured":"Fenggen Yu Zhiqin Chen Manyi Li Aditya Sanghi Hooman Shayani Ali Mahdavi-Amiri and Hao Zhang. 2021. CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assembly. arXiv:2104.05652 [cs.CV]"},{"key":"e_1_2_2_57_1","volume-title":"Proceedings of SIGGRAPH (Computer Graphics Proceedings, Annual Conference Series). 163--170","author":"Zeleznik Robert C.","unstructured":"Robert C. Zeleznik, Kenneth P. Herndon, and John F. Hughes. 1996. SKETCH: An Interface for Sketching 3D Scenes. In Proceedings of SIGGRAPH (Computer Graphics Proceedings, Annual Conference Series). 163--170."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3528223.3530133","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3528223.3530133","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:48Z","timestamp":1750186968000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3528223.3530133"}},"subtitle":["parsing freehand drawings into CAD commands"],"short-title":[],"issued":{"date-parts":[[2022,7]]},"references-count":57,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10.1145\/3528223.3530133"],"URL":"https:\/\/doi.org\/10.1145\/3528223.3530133","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7]]},"assertion":[{"value":"2022-07-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}