{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T21:40:46Z","timestamp":1767994846503,"version":"3.49.0"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2024,11,1]],"date-time":"2024-11-01T00:00:00Z","timestamp":1730419200000},"content-version":"vor","delay-in-days":2,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52188102"],"award-info":[{"award-number":["52188102"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52375013"],"award-info":[{"award-number":["52375013"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003819","name":"Natural Science Foundation of Hubei Province","doi-asserted-by":"publisher","award":["2024AFA008"],"award-info":[{"award-number":["2024AFA008"]}],"id":[{"id":"10.13039\/501100003819","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,11,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Traditional industrial surface defect detection method often employs CCD\/CMOS cameras, but they are unable to detect the minute defects on aluminum substrates in highly dynamic industrial scenes due to their nature. Event camera is a novel high-resolution vision sensor that measures per-pixel brightness changes in an asynchronous manner and outputs as event information flow (EIF). Small and weak defects on aluminum substrate can be captured by event camera effectively, but the EIF contains a large amount of noise, making it difficult to perform accurate and high-precision defect detection. To address this problem, we propose a frame aggregation method to realize good event information flow processing, and then use an improved circle detection method to locate the aluminum substrate in each frame, removing abundant event information outside the aluminum substrate. Subsequently, we enhance the event signals under different frames based on optical flow tracking using multiple features, and construct a semi-supervised detector based on pseudo-labels to achieve high-precision defect localization. Finally, considering the small inter-class differences in defects on the surface of aluminum substrates, we construct a defect class corrector based on ensemble learning to enhance the ability to determine defect classes, achieving high-precision automatic quality inspection of aluminum substrate surfaces. The performance of our method is compared with other advanced methods based on event camera data of aluminum substrates in real industrial scenarios. The experimental results show that our method has improved the detection accuracy by \u223c10% and the classification accuracy by \u223c25% compared to the original state-of-the-art methods.<\/jats:p>","DOI":"10.1093\/jcde\/qwae097","type":"journal-article","created":{"date-parts":[[2024,11,1]],"date-time":"2024-11-01T10:29:15Z","timestamp":1730456955000},"page":"232-243","source":"Crossref","is-referenced-by-count":5,"title":["High-performance surface defect detection of aluminum substrate based on event camera"],"prefix":"10.1093","volume":"11","author":[{"given":"Jing","family":"Tang","sequence":"first","affiliation":[{"name":"State Key Laboratory of Intelligent Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology , Luoyu East Road 1037 , Wuhan, Hubei 430074,","place":["China"]}]},{"given":"Zeyu","family":"Gong","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Intelligent Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology , Luoyu East Road 1037 , Wuhan, Hubei 430074,","place":["China"]}]},{"given":"Yajun","family":"Fan","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Intelligent Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology , Luoyu East Road 1037 , Wuhan, Hubei 430074,","place":["China"]},{"name":"Institute of Robotics, Wuhan Digital Design and Manufacturing Innovation Centre Co.,Ltd. , Ligou South Road 8 , Wuhan, Hubei 430074,","place":["China"]}]}],"member":"286","published-online":{"date-parts":[[2024,10,30]]},"reference":[{"key":"2024121710012025700_bib1","doi-asserted-by":"publisher","first-page":"3177","DOI":"10.1109\/LRA.2018.2849882","article-title":"Asynchronous corner detection and tracking for event cameras in real time","volume":"3","author":"Alzugaray","year":"2018","journal-title":"IEEE Robotics and Automation Letters"},{"key":"2024121710012025700_bib2","doi-asserted-by":"publisher","first-page":"102419","DOI":"10.1016\/j.rcim.2022.102419","article-title":"Neuromorphic vision based control for the precise positioning of robotic drilling systems","volume":"79","author":"Ayyad","year":"2023","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"key":"2024121710012025700_bib3","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1109\/TNNLS.2013.2273537","article-title":"Event-based visual flow","volume":"25","author":"Benosman","year":"2013","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"2024121710012025700_bib4","doi-asserted-by":"publisher","first-page":"1483","DOI":"10.1109\/TPAMI.2019.2956516","article-title":"Cascade r-cnn: High quality object detection and instance segmentation","volume":"43","author":"Cai","year":"2019","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2024121710012025700_bib5","doi-asserted-by":"publisher","first-page":"2879","DOI":"10.1109\/TPAMI.2022.3185773","article-title":"Data augmentation in high dimensional low sample size setting using a geometry-based variational autoencoder","volume":"45","author":"Chadebec","year":"2022","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2024121710012025700_bib6","first-page":"1","article-title":"Dcam-net: A rapid detection network for strip steel surface defects based on deformable convolution and attention mechanism","volume":"72","author":"Chen","year":"2023","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"2024121710012025700_bib7","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1145\/2939672.2939785","article-title":"Xgboost: A scalable tree boosting system","volume-title":"Proceedings of the 22nd acm Sigkdd International Conference on Knowledge Discovery and Data Mining","author":"Chen","year":"2016"},{"key":"2024121710012025700_bib8","first-page":"1290","article-title":"Masked-attention mask transformer for universal image segmentation","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Cheng","year":"2022"},{"key":"2024121710012025700_bib9","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1142\/S0129065709002002","article-title":"Spiking neural networks","volume":"19","author":"Ghosh-Dastidar","year":"2009","journal-title":"International Journal of Neural Systems"},{"key":"2024121710012025700_bib10","doi-asserted-by":"publisher","first-page":"nwad130","DOI":"10.1093\/nsr\/nwad130","article-title":"Surface defect detection competition with a bio-inspired vision sensor","volume":"10","author":"Guo","year":"2023","journal-title":"National Science Review"},{"key":"2024121710012025700_bib11","first-page":"2961","article-title":"Mask r-cnn","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"He","year":"2017"},{"key":"2024121710012025700_bib12","first-page":"6409","article-title":"Mask scoring r-cnn","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Huang","year":"2019"},{"key":"2024121710012025700_bib13","article-title":"Lightgbm: a highly efficient gradient boosting decision tree","volume":"30","author":"Ke","year":"2017","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2024121710012025700_bib14","doi-asserted-by":"publisher","first-page":"1602","DOI":"10.1093\/jcde\/qwad069","article-title":"Broken stitch detection system for industrial sewing machines using hsv color space and image processing techniques","volume":"10","author":"Kim","year":"2023","journal-title":"Journal of Computational Design and Engineering"},{"key":"2024121710012025700_bib15","first-page":"11270","article-title":"Spiking-yolo: spiking neural network for energy-efficient object detection","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Kim","year":"2020"},{"key":"2024121710012025700_bib16","doi-asserted-by":"publisher","first-page":"1346","DOI":"10.1109\/TPAMI.2016.2574707","article-title":"Hots: a hierarchy of event-based time-surfaces for pattern recognition","volume":"39","author":"Lagorce","year":"2016","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2024121710012025700_bib17","article-title":"Yolov6: A single-stage object detection framework for industrial applications","author":"Li","year":"2022"},{"issue":"1","key":"2024121710012025700_bib18","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2023.3262854","article-title":"Intelligent machinery fault diagnosis with event-based camera","volume":"20","author":"Li","year":"2023","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"2024121710012025700_bib19","first-page":"934","article-title":"Graph-based asynchronous event processing for rapid object recognition","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Li","year":"2021"},{"key":"2024121710012025700_bib20","first-page":"1308","article-title":"Effective aer object classification using segmented probability-maximization learning in spiking neural networks","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Liu","year":"2020"},{"key":"2024121710012025700_bib21","doi-asserted-by":"publisher","first-page":"120284","DOI":"10.1016\/j.eswa.2023.120284","article-title":"Anomaly-gan: A data augmentation method for train surface anomaly detection","volume":"228","author":"Liu","year":"2023","journal-title":"Expert Systems with Applications"},{"key":"2024121710012025700_bib22","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1109\/BioCAS.2013.6679698","article-title":"A spiking neural network architecture for visual motion estimation","volume-title":"2013 IEEE Biomedical Circuits and Systems Conference (BioCAS)","author":"Orchard","year":"2013"},{"key":"2024121710012025700_bib23","doi-asserted-by":"publisher","first-page":"2028","DOI":"10.1109\/TPAMI.2015.2392947","article-title":"Hfirst: A temporal approach to object recognition","volume":"37","author":"Orchard","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2024121710012025700_bib24","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1109\/IWSSIP48289.2020.9145130","article-title":"A survey on performance metrics for object-detection algorithms","volume-title":"2020 International Conference on Systems, Signals and Image Processing (IWSSIP)","author":"Padilla","year":"2020"},{"key":"2024121710012025700_bib25","doi-asserted-by":"publisher","first-page":"2466","DOI":"10.1093\/jcde\/qwac115","article-title":"Novel industrial surface-defect detection using deep nested convolutional network with attention and guidance modules","volume":"9","author":"Park","year":"2022","journal-title":"Journal of Computational Design and Engineering"},{"key":"2024121710012025700_bib26","doi-asserted-by":"publisher","first-page":"2466","DOI":"10.1093\/jcde\/qwac115","article-title":"Novel industrial surface-defect detection using deep nested convolutional network with attention and guidance modules","volume":"9","author":"Park","year":"2022","journal-title":"Journal of Computational Design and Engineering"},{"key":"2024121710012025700_bib27","article-title":"Catboost: unbiased boosting with categorical features","volume":"31","author":"Prokhorenkova","year":"2018","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2024121710012025700_bib28","article-title":"Yolov3: an incremental improvement","author":"Redmon","year":"2018"},{"key":"2024121710012025700_bib29","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1007\/11744023_34","article-title":"Machine learning for high-speed corner detection","volume-title":"Computer Vision\u2013ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, May 7-13, 2006. Proceedings, Part I 9","author":"Rosten","year":"2006"},{"key":"2024121710012025700_bib30","first-page":"12371","article-title":"Aegnn: Asynchronous event-based graph neural networks","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Schaefer","year":"2022"},{"key":"2024121710012025700_bib31","first-page":"3887","article-title":"Eventnet: Asynchronous recursive event processing","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Sekikawa","year":"2019"},{"key":"2024121710012025700_bib32","first-page":"593","article-title":"Good features to track","volume-title":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","author":"Shi","year":"1994"},{"key":"2024121710012025700_bib33","doi-asserted-by":"publisher","first-page":"1423","DOI":"10.1093\/jcde\/qwad067","article-title":"Detecting balling defects using multisource transfer learning in wire arc additive manufacturing","volume":"10","author":"Shin","year":"2023","journal-title":"Journal of Computational Design and Engineering"},{"key":"2024121710012025700_bib34","first-page":"6555","article-title":"Deep directly-trained spiking neural networks for object detection","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Su","year":"2023"},{"key":"2024121710012025700_bib35","first-page":"7464","article-title":"Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Wang","year":"2023"},{"key":"2024121710012025700_bib36","doi-asserted-by":"publisher","first-page":"1976","DOI":"10.1109\/LRA.2022.3140819","article-title":"Vmv-gcn: Volumetric multi-view based graph cnn for event stream classification","volume":"7","author":"Xie","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"key":"2024121710012025700_bib37","article-title":"Efficient teacher: Semi-supervised object detection for yolov5","author":"Xu","year":"2023"},{"key":"2024121710012025700_bib38","first-page":"3060","article-title":"End-to-end semi-supervised object detection with soft teacher","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Xu","year":"2021"},{"key":"2024121710012025700_bib39","first-page":"6023","article-title":"Cutmix: Regularization strategy to train strong classifiers with localizable features","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Yun","year":"2019"},{"key":"2024121710012025700_bib40","doi-asserted-by":"crossref","first-page":"1616","DOI":"10.1093\/jcde\/qwac071","article-title":"A novel deep convolutional neural network algorithm for surface defect detection","volume":"9","author":"Zhang","year":"2022","journal-title":"Journal of Computational Design and Engineering"},{"key":"2024121710012025700_bib41","doi-asserted-by":"crossref","first-page":"10651","DOI":"10.1007\/s10462-023-10438-y","article-title":"An efficient lightweight convolutional neural network for industrial surface defect detection","volume":"56","author":"Zhang","year":"2023","journal-title":"Artificial Intelligence Review"},{"key":"2024121710012025700_bib42","article-title":"mixup: Beyond empirical risk minimization","author":"Zhang","year":"2017"},{"key":"2024121710012025700_bib43","first-page":"23809","article-title":"Semi-detr: Semi-supervised object detection with detection transformers","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Zhang","year":"2023"}],"container-title":["Journal of Computational Design and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jcde\/advance-article-pdf\/doi\/10.1093\/jcde\/qwae097\/60283170\/qwae097.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/11\/6\/232\/61212328\/qwae097.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/11\/6\/232\/61212328\/qwae097.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,17]],"date-time":"2024-12-17T10:02:10Z","timestamp":1734429730000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcde\/article\/11\/6\/232\/7861043"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,30]]},"references-count":43,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,11,8]]}},"URL":"https:\/\/doi.org\/10.1093\/jcde\/qwae097","relation":{},"ISSN":["2288-5048"],"issn-type":[{"value":"2288-5048","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,12]]},"published":{"date-parts":[[2024,10,30]]}}}