{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T16:29:58Z","timestamp":1775233798299,"version":"3.50.1"},"reference-count":27,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T00:00:00Z","timestamp":1671753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010418","name":"Information &amp; Communications Technology Planning &amp; Evaluation (IITP)","doi-asserted-by":"publisher","award":["2020-0-00959"],"award-info":[{"award-number":["2020-0-00959"]}],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Generative adversarial network (GAN)-based data augmentation is used to enhance the performance of object detection models. It comprises two stages: training the GAN generator to learn the distribution of a small target dataset, and sampling data from the trained generator to enhance model performance. In this paper, we propose a pipelined model, called robust data augmentation GAN (RDAGAN), that aims to augment small datasets used for object detection. First, clean images and a small datasets containing images from various domains are input into the RDAGAN, which then generates images that are similar to those in the input dataset. Thereafter, it divides the image generation task into two networks: an object generation network and image translation network. The object generation network generates images of the objects located within the bounding boxes of the input dataset and the image translation network merges these images with clean images. A quantitative experiment confirmed that the generated images improve the YOLOv5 model\u2019s fire detection performance. A comparative evaluation showed that RDAGAN can maintain the background information of input images and localize the object generation location. Moreover, ablation studies demonstrated that all components and objects included in the RDAGAN play pivotal roles.<\/jats:p>","DOI":"10.3390\/s23010157","type":"journal-article","created":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T02:55:07Z","timestamp":1672109707000},"page":"157","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Robust Data Augmentation Generative Adversarial Network for Object Detection"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1598-1131","authenticated-orcid":false,"given":"Hyungtak","family":"Lee","sequence":"first","affiliation":[{"name":"School of Computer and Information Engineering, Kwangwoon University, Seoul 01897, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8306-2028","authenticated-orcid":false,"given":"Seongju","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Electronics and Communications Engineering, Kwangwoon University, Seoul 01897, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0283-0900","authenticated-orcid":false,"given":"Kwangsue","family":"Chung","sequence":"additional","affiliation":[{"name":"Department of Electronics and Communications Engineering, Kwangwoon University, Seoul 01897, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft COCO: Common Objects in Context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on Image Data Augmentation for Deep Learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_4","unstructured":"Liu, L., Muelly, M., Deng, J., Pfister, T., and Li, L.J. (November, January 27). Generative Modeling for Small-Data Object Detection. Proceedings of the International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_5","unstructured":"Higgins, I., Amos, D., Pfau, D., Racaniere, S., Matthey, L., Rezende, D., and Lerchner, A. (2018). Towards a Definition of Disentangled Representations. arXiv."},{"key":"ref_6","unstructured":"Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., and Abbeel, P. (2016, January 5\u201310). InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Huang, X., Liu, M.Y., Belongie, S., and Kautz, J. (2018, January 8\u201314). Multimodal Unsupervised Image-to-image Translation. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01219-9_11"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-To-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3859","DOI":"10.1109\/TMM.2021.3109419","article-title":"Image-to-Image Translation: Methods and Applications","volume":"24","author":"Pang","year":"2022","journal-title":"IEEE Trans. Multimed."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Park, T., Efros, A.A., Zhang, R., and Zhu, J.Y. (2020, January 23\u201328). Contrastive Learning for Unpaired Image-to-Image Translation. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58545-7_19"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.neucom.2018.09.013","article-title":"GAN-based Synthetic Medical Image Augmentation for Increased CNN Performance in Liver Lesion Classification","volume":"321","author":"Diamant","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"9318","DOI":"10.1109\/JSTARS.2021.3110842","article-title":"Remote Sensing Data Augmentation Through Adversarial Training","volume":"14","author":"Lv","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","unstructured":"Ouyang, X., Cheng, Y., Jiang, Y., Li, C.L., and Zhou, P. (2018). Pedestrian-Synthesis-GAN: Generating Pedestrian Data in Real Scene and Beyond. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sandro Campos, D.S. (2022, January 3\u20135). Aerial Fire Image Synthesis and Detection. Proceedings of the International Conference on Agents and Artificial Intelligence, Online.","DOI":"10.5220\/0010829400003116"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Park, M., Tran, D.Q., Jung, D., and Park, S. (2020). Wildfire-Detection Method Using DenseNet and CycleGAN Data Augmentation-Based Remote Camera Imagery. Remote Sens., 12.","DOI":"10.3390\/rs12223715"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/s10694-021-01117-x","article-title":"Training with Augmented Data: GAN-based Flame-Burning Image Synthesis for Fire Segmentation in Warehouse","volume":"58","author":"Yang","year":"2022","journal-title":"Fire Technol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Qin, K., Hou, X., Yan, Z., Zhou, F., and Bu, L. (2022). FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition. Sensors, 22.","DOI":"10.3390\/s22176332"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative adversarial networks","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, Y., Liu, S., Yang, J., and Yang, M.H. (2017, January 21\u201326). Generative Face Completion. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.624"},{"key":"ref_22","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_24","unstructured":"Cazzolato, M.T., Avalhais, L.P.S., Chino, D.Y.T., Ramos, J.S., de Souza, J.A., Rodrigues, J.F., and Traina, A.J.M. (2017, January 4\u20137). FiSmo: A Compilation of Datasets from Emergency Situations for Fire and Smoke Analysis. Proceedings of the Brazilian Symposium on Databases, Uberlandia, Brazil."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Weyand, T., Araujo, A., Cao, B., and Sim, J. (2020, January 13\u201319). Google Landmarks Dataset v2\u2014A Large-Scale Benchmark for Instance-Level Recognition and Retrieval. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00265"},{"key":"ref_26","unstructured":"Jocher, G., Stoken, A., Chaurasia, A., Borovec, J., NanoCode012, Xie, T., Kwon, Y., Michael, K., Changyu, L., and Fang, J. (2021). ultralytics\/yolov5: v6.0\u2013YOLOv5x \u2019XLarge\u2019 models, Roboflow integration, TensorFlow export, OpenCV DNN support. Zenodo Tech. Rep."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s11263-019-01247-4","article-title":"Deep Learning for Generic Object Detection: A Survey","volume":"128","author":"Liu","year":"2020","journal-title":"Int. J. Comput. Vis."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/157\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:49:33Z","timestamp":1760147373000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/157"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,23]]},"references-count":27,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010157"],"URL":"https:\/\/doi.org\/10.3390\/s23010157","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,23]]}}}