{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T05:29:49Z","timestamp":1777526989233,"version":"3.51.4"},"reference-count":56,"publisher":"ASME International","issue":"1","license":[{"start":{"date-parts":[[2023,6,15]],"date-time":"2023-06-15T00:00:00Z","timestamp":1686787200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.asme.org\/publications-submissions\/publishing-information\/legal-policies"}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>We present a new data generation method to facilitate an automatic machine interpretation of 2D engineering part drawings. While such drawings are a common medium for clients to encode design and manufacturing requirements, a lack of computer support to automatically interpret these drawings necessitates part manufacturers to resort to laborious manual approaches for interpretation which, in turn, severely limits processing capacity. Although recent advances in trainable computer vision methods may enable automatic machine interpretation, it remains challenging to apply such methods to engineering drawings due to a lack of labeled training data. As one step toward this challenge, we propose a constrained data synthesis method to generate an arbitrarily large set of synthetic training drawings using only a handful of labeled examples. Our method is based on the randomization of the dimension sets subject to two major constraints to ensure the validity of the synthetic drawings. The effectiveness of our method is demonstrated in the context of a binary component segmentation task with a proposed list of descriptors. An evaluation of several image segmentation methods trained on our synthetic dataset shows that our approach to new data generation can boost the segmentation accuracy and the generalizability of the machine learning models to unseen drawings.<\/jats:p>","DOI":"10.1115\/1.4062233","type":"journal-article","created":{"date-parts":[[2023,3,29]],"date-time":"2023-03-29T07:25:24Z","timestamp":1680074724000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":5,"title":["A Data Augmentation Method for Data-Driven Component Segmentation of Engineering Drawings"],"prefix":"10.1115","volume":"24","author":[{"given":"Wentai","family":"Zhang","sequence":"first","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Joe","family":"Joseph","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Quan","family":"Chen","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Can","family":"Koz","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Liuyue","family":"Xie","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Amit","family":"Regmi","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Soji","family":"Yamakawa","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Tomotake","family":"Furuhata","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Kenji","family":"Shimada","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]},{"given":"Levent Burak","family":"Kara","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15213"}]}],"member":"33","published-online":{"date-parts":[[2023,6,15]]},"reference":[{"issue":"2\u20134","key":"2023061515341870500_CIT0001","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1504\/IJCAT.2005.006467","article-title":"Content-Based Retrieval of Technical Drawings","volume":"23","author":"Fonseca","year":"2005","journal-title":"Int. J. Comput. Appl. Technol."},{"key":"2023061515341870500_CIT0002","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1016\/j.jvlc.2014.12.010","article-title":"Individual Strategies in the Tasks of Graphical Retrieval of Technical Drawings","volume":"28","author":"Kasimov","year":"2015","journal-title":"J. Vis. Lang. Comput."},{"issue":"3","key":"2023061515341870500_CIT0003","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1016\/j.aei.2015.06.001","article-title":"A Hybrid Cost Estimation Framework Based on Feature-Oriented Data Mining Approach","volume":"29","author":"Sajadfar","year":"2015","journal-title":"Adv. Eng. Inform."},{"key":"2023061515341870500_CIT0004","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1108\/13552540010309859","article-title":"A Review of Process Planning Techniques in Layered Manufacturing","volume":"6","author":"Kulkarni","year":"2000","journal-title":"Rapid Prototyp. J."},{"key":"2023061515341870500_CIT0005","article-title":"A Survey on Projects and Issues in Japan\u2019s Manufacturing Industry","author":"Mitsubishi UFJ Research & Consulting Co., L.","year":"2019"},{"key":"2023061515341870500_CIT0006","first-page":"779","article-title":"You Only Look Once: Unified, Real-Time Object Detection","author":"Redmon","year":"2016"},{"key":"2023061515341870500_CIT0007","first-page":"2961","article-title":"Mask R-CNN","author":"He","year":"2017"},{"issue":"10","key":"2023061515341870500_CIT0008","doi-asserted-by":"publisher","first-page":"3349","DOI":"10.1109\/TPAMI.2020.2983686","article-title":"Deep High-Resolution Representation Learning for Visual Recognition","volume":"43","author":"Wang","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2023061515341870500_CIT0009","first-page":"3431","article-title":"Fully Convolutional Networks for Semantic Segmentation","author":"Long","year":"2015"},{"key":"2023061515341870500_CIT0010","first-page":"234","article-title":"U-net: Convolutional Networks for Biomedical Image Segmentation","author":"Ronneberger","year":"2015"},{"key":"2023061515341870500_CIT0011","first-page":"801","article-title":"Encoder\u2013Decoder With Atrous Separable Convolution for Semantic Image Segmentation","author":"Chen","year":"2018"},{"key":"2023061515341870500_CIT0012","article-title":"VisualBERT: A Simple and Performant Baseline for Vision and Language","author":"Li","year":"2019","journal-title":"arXiv preprint"},{"key":"2023061515341870500_CIT0013","first-page":"10267","article-title":"In Defense of Grid Features for Visual Question Answering","author":"Jiang","year":"2020"},{"key":"2023061515341870500_CIT0014","article-title":"Vlmo: Unified Vision-Language Pre-Training With Mixture-of-Modality-Experts","author":"Wang","year":"2022"},{"key":"2023061515341870500_CIT0015","article-title":"Patchshuffle Regularization","author":"Kang","year":"2017"},{"key":"2023061515341870500_CIT0016","first-page":"13001","article-title":"Random Erasing Data Augmentation","author":"Zhong","year":"2020"},{"key":"2023061515341870500_CIT0017","doi-asserted-by":"crossref","DOI":"10.5244\/C.28.6","article-title":"Return of the Devil in the Details: Delving Deep Into Convolutional Nets","author":"Chatfield","year":"2014"},{"key":"2023061515341870500_CIT0018","article-title":"Data Augmentation by Pairing Samples for Images Classification","author":"Inoue","year":"2018"},{"key":"2023061515341870500_CIT0019","first-page":"1","article-title":"Carla: An Open Urban Driving Simulator","author":"Dosovitskiy","year":"2017"},{"key":"2023061515341870500_CIT0020","first-page":"1","article-title":"Self-Driving Car Steering Angle Prediction Based on Deep Neural Network an Example of Carnd Udacity Simulator","author":"Smolyakov","year":"2018"},{"key":"2023061515341870500_CIT0021","first-page":"0846","article-title":"Simulation of a Pick-and-Place Cube Robot by Means of the Simulation Software Kuka Sim Pro","author":"Luka\u010d","year":"2018"},{"key":"2023061515341870500_CIT0022","article-title":"Lagrangian Fluid Simulation With Continuous Convolutions","author":"Ummenhofer","year":"2020"},{"issue":"2","key":"2023061515341870500_CIT0023","doi-asserted-by":"publisher","first-page":"027104","DOI":"10.1063\/5.0033376","article-title":"A Point-Cloud Deep Learning Framework for Prediction of Fluid Flow Fields on Irregular Geometries","volume":"33","author":"Kashefi","year":"2021","journal-title":"Phys. Fluids"},{"issue":"11","key":"2023061515341870500_CIT0024","doi-asserted-by":"publisher","first-page":"e2020MS002203","DOI":"10.1029\/2020MS002203","article-title":"Weatherbench: A Benchmark Data Set for Data-Driven Weather Forecasting","volume":"12","author":"Rasp","year":"2020","journal-title":"J. Adv. Model. Earth Syst."},{"issue":"4","key":"2023061515341870500_CIT0025","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1016\/S0146-664X(81)80015-9","article-title":"A Segmentation System Based on Thresholding","volume":"15","author":"Kohler","year":"1981","journal-title":"Comput. Graph. Image Process."},{"key":"2023061515341870500_CIT0026","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1016\/j.neunet.2012.04.012","article-title":"A Pixel-Based Color Image Segmentation Using Support Vector Machine and Fuzzy C-Means","volume":"33","author":"Wang","year":"2012","journal-title":"Neural Netw."},{"issue":"9","key":"2023061515341870500_CIT0027","doi-asserted-by":"crossref","first-page":"1731","DOI":"10.1109\/TPAMI.2011.208","article-title":"Layered Object Models for Image Segmentation","volume":"34","author":"Yang","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"12","key":"2023061515341870500_CIT0028","doi-asserted-by":"publisher","first-page":"1673","DOI":"10.1109\/83.730379","article-title":"Image Segmentation Via Adaptive K-Mean Clustering and Knowledge-Based Morphological Operations With Biomedical Applications","volume":"7","author":"Chen","year":"1998","journal-title":"IEEE Trans. Image Process."},{"key":"2023061515341870500_CIT0029","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1016\/j.procs.2015.06.090","article-title":"Image Segmentation Using K-Means Clustering Algorithm and Subtractive Clustering Algorithm","volume":"54","author":"Dhanachandra","year":"2015","journal-title":"Procedia Comput. Sci."},{"issue":"1","key":"2023061515341870500_CIT0030","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1007\/s11263-007-0109-1","article-title":"Textonboost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context","volume":"81","author":"Shotton","year":"2009","journal-title":"Int. J. Comput. Vision"},{"key":"2023061515341870500_CIT0031","doi-asserted-by":"publisher","first-page":"109","DOI":"10.48550\/arXiv.1210.5644","article-title":"Efficient Inference in Fully Connected CRFs With Gaussian Edge Potentials","volume":"24","author":"Kr\u00e4henb\u00fchl","year":"2011","journal-title":"Adv. Neural Inf. Process. Syst."},{"issue":"4","key":"2023061515341870500_CIT0032","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Semantic Image Segmentation With Deep Convolutional Nets and Fully Connected CRFS","volume":"40","author":"Chen","year":"2014","journal-title":"IEEE Trans. Patt. Anal. Mach. Intell."},{"key":"2023061515341870500_CIT0033","first-page":"1529","article-title":"Conditional Random Fields as Recurrent Neural Networks","author":"Zheng","year":"2015"},{"key":"2023061515341870500_CIT0034","first-page":"402","article-title":"Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation With Deep Gaussian CRFs","author":"Chandra","year":"2016"},{"issue":"3","key":"2023061515341870500_CIT0035","doi-asserted-by":"crossref","first-page":"374","DOI":"10.18178\/ijmlc.2019.9.3.813","article-title":"Handwritten Electric Circuit Diagram Recognition: An Approach Based on Finite State Machine","volume":"9","author":"Lakshman Naika","year":"2019","journal-title":"Int. J. Mach. Learn. Comput."},{"issue":"12","key":"2023061515341870500_CIT0036","doi-asserted-by":"publisher","first-page":"3215","DOI":"10.1016\/j.patcog.2009.01.031","article-title":"On-Line Hand-Drawn Electric Circuit Diagram Recognition Using 2d Dynamic Programming","volume":"42","author":"Feng","year":"2009","journal-title":"Pattern Recognit."},{"issue":"1","key":"2023061515341870500_CIT0037","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10032-020-00361-1","article-title":"Arrow R-CNN for Handwritten Diagram Recognition","volume":"24","author":"Sch\u00e4fer","year":"2021","journal-title":"Int. J. Doc. Anal. Recognit."},{"issue":"3","key":"2023061515341870500_CIT0038","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/s10032-010-0120-x","article-title":"Generation of Synthetic Documents for Performance Evaluation of Symbol Recognition & Spotting Systems","volume":"13","author":"Delalandre","year":"2010","journal-title":"Int. J. Doc. Anal. Recognit."},{"issue":"10","key":"2023061515341870500_CIT0039","doi-asserted-by":"publisher","first-page":"101101","DOI":"10.1115\/1.2965595","article-title":"A Sketch-Based Tool for Analyzing Vibratory Mechanical Systems","volume":"130","author":"Kara","year":"2008","journal-title":"ASME J. Mech. Des."},{"key":"2023061515341870500_CIT0040","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/s10032-006-0029-6","article-title":"Automatic Analysis and Integration of Architectural Drawings","volume":"9","author":"Lu","year":"2007","journal-title":"Int. J. Doc. Anal. Recognit."},{"issue":"13","key":"2023061515341870500_CIT0041","doi-asserted-by":"publisher","first-page":"2593","DOI":"10.3390\/en12132593","article-title":"A Digitization and Conversion Tool for Imaged Drawings to Intelligent Piping and Instrumentation Diagrams (P&ID)","volume":"12","author":"Kang","year":"2019","journal-title":"Energies"},{"key":"2023061515341870500_CIT0042","first-page":"267","article-title":"Chemink: A Natural Real-Time Recognition System for Chemical Drawings","author":"Ouyang","year":"2011"},{"key":"2023061515341870500_CIT0043","first-page":"289","article-title":"A. Scatch-a Sketch-Based Retrieval for Architectural Floor Plans","author":"Weber","year":"2010"},{"issue":"4","key":"2023061515341870500_CIT0044","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1007\/s10032-019-00340-1","article-title":"A Novel Feature Transform Framework Using Deep Neural Network for Multimodal Floor Plan Retrieval","volume":"22","author":"Sharma","year":"2019","journal-title":"Int. J. Doc. Anal. Recognit."},{"key":"2023061515341870500_CIT0045","first-page":"339","article-title":"Automatic Room Detection and Room Labeling From Architectural Floor Plans","author":"Ahmed","year":"2012"},{"key":"2023061515341870500_CIT0046","doi-asserted-by":"crossref","DOI":"10.5565\/rev\/elcvia.732","volume-title":"Relational Models for Visual Understanding of Graphical Documents. Application to Architectural Drawings","author":"de las Heras","year":"2015"},{"key":"2023061515341870500_CIT0047","first-page":"232","article-title":"Online Handwritten Diagram Recognition With Graph Attention Networks","author":"Yun","year":"2019"},{"key":"2023061515341870500_CIT0048","first-page":"3264","article-title":"Joint Training of Conditional Random Fields and Neural Networks for Stroke Classification in Online Handwritten Documents","author":"Ye","year":"2016"},{"key":"2023061515341870500_CIT0049","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1016\/j.patcog.2015.07.012","article-title":"Combination of Global and Local Contexts for Text\/Non-text Classification in Heterogeneous Online Handwritten Documents","volume":"51","author":"Van Phan","year":"2016","journal-title":"Pattern Recognit."},{"key":"2023061515341870500_CIT0050","doi-asserted-by":"crossref","first-page":"103885","DOI":"10.1016\/j.compind.2023.103885","article-title":"Component Segmentation of Engineering Drawings Using Graph Convolutional Networks","volume":"147","author":"Zhang","year":"2022","journal-title":"Comput. Ind."},{"issue":"3","key":"2023061515341870500_CIT0051","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1016\/S0146-664X(72)80017-0","article-title":"An Iterative Procedure for the Polygonal Approximation of Plane Curves","volume":"1","author":"Ramer","year":"1972","journal-title":"Comput. Graph. Image Process."},{"issue":"2","key":"2023061515341870500_CIT0052","first-page":"112","article-title":"Algorithms for the Reduction of the Number of Points Required to Represent a Digitized Line or Its Caricature","volume":"10","author":"Douglas","year":"1973","journal-title":"Cartogr. Int. J. Geogr. Inf. Geovis."},{"key":"2023061515341870500_CIT0053","article-title":"Adam: A Method for Stochastic Optimization","author":"Kingma","year":"2014"},{"key":"2023061515341870500_CIT0054","first-page":"374","article-title":"AI-Based Engineering and Production Drawing Information Extraction","author":"Haar","year":"2022"},{"key":"2023061515341870500_CIT0055","doi-asserted-by":"publisher","first-page":"103442","DOI":"10.1016\/j.compind.2021.103442","article-title":"Extraction of Dimension Requirements From Engineering Drawings for Supporting Quality Control in Production Processes","volume":"129","author":"Scheibel","year":"2021","journal-title":"Comput. Ind."},{"key":"2023061515341870500_CIT0056","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/j.patrec.2013.04.005","article-title":"Automatic Analysis and Sketch-Based Retrieval of Architectural Floor Plans","volume":"35","author":"Ahmed","year":"2014","journal-title":"Pattern Recognit. Lett."}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/24\/1\/011001\/7019586\/jcise_24_1_011001.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/24\/1\/011001\/7019586\/jcise_24_1_011001.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,15]],"date-time":"2023-06-15T15:34:30Z","timestamp":1686843270000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/24\/1\/011001\/1160387\/A-Data-Augmentation-Method-for-Data-Driven"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,15]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4062233","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"value":"1530-9827","type":"print"},{"value":"1944-7078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,15]]},"article-number":"011001"}}