{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T16:02:15Z","timestamp":1783008135225,"version":"3.54.5"},"reference-count":45,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2023,11,28]],"date-time":"2023-11-28T00:00:00Z","timestamp":1701129600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Moroccan School of Engineering Sciences EMSI Casablanca"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Frequency modulated continuous wave (FMCW) radar is increasingly used for various detection and classification applications in different fields, such as autonomous vehicles and mining fields. Our objective is to increase the classification accuracy of objects detected using millimeter-wave radar. We have developed an approach based on millimeter-wave radar. The proposed solution combines the use of an FMCW radar, a YOLOv7 model, and the Pix2Pix architecture. The latter architecture was used to reduce noise in the heatmaps. We create a dataset of 4125 heatmaps annotated with five different object classes. To evaluate the proposed approach, 14 different models were trained using the annotated heatmap dataset. In the initial experiment, we compared the models using metrics such as mean average precision (mAP), precision, and recall. The results showed that the proposed model of YOLOv7 (YOLOv7-PM) was the most efficient in terms of mAP_0.5, which reached 90.1%, and achieved a mAP_0.5:0.95 of 49.51%. In the second experiment, we compared the models with a cleaned dataset generated using the Pix2Pix architecture. As a result, we observed improved performances, with the Pix2Pix + YOLOv7-PM model achieving the best mAP_0.5, reaching 91.82%, and a mAP_0.5:0.95 of 52.59%.<\/jats:p>","DOI":"10.3390\/s23239456","type":"journal-article","created":{"date-parts":[[2023,11,28]],"date-time":"2023-11-28T07:41:32Z","timestamp":1701157292000},"page":"9456","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["New Approach Based on Pix2Pix\u2013YOLOv7 mmWave Radar for Target Detection and Classification"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-0594-0611","authenticated-orcid":false,"given":"Mohamed","family":"Lamane","sequence":"first","affiliation":[{"name":"MiSET Team, Faculty of Sciences and Technics FST, Sultan Moulay Slimane University, Beni Mellal 23030, Morocco"},{"name":"Pluridisciplinary Laboratory of Research & Innovation (LPRI), EMSI, Casablanca 23300, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohamed","family":"Tabaa","sequence":"additional","affiliation":[{"name":"Pluridisciplinary Laboratory of Research & Innovation (LPRI), EMSI, Casablanca 23300, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3662-8727","authenticated-orcid":false,"given":"Abdessamad","family":"Klilou","sequence":"additional","affiliation":[{"name":"MiSET Team, Faculty of Sciences and Technics FST, Sultan Moulay Slimane University, Beni Mellal 23030, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1049\/iet-rsn.2015.0118","article-title":"Review of micro-Doppler signatures","volume":"9","author":"Tahmoush","year":"2015","journal-title":"IET Radar Sonar Navig."},{"key":"ref_2","first-page":"1167","article-title":"A comprehensive review of the development of adaptive cruise control systems","volume":"48","author":"Xiao","year":"2010","journal-title":"Int. J. Veh. Mech. Mobil."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1369","DOI":"10.1631\/jzus.A0820111","article-title":"Blind spot detection using vision for automotive applications","volume":"9","author":"Sotelo","year":"2008","journal-title":"J. Zhejiang Univ.-Sci. A"},{"key":"ref_4","first-page":"16043","article-title":"Localization and Activity Classification of Unmanned Aerial Vehicle using mmWave FMCW Radars","volume":"21","author":"Prabhat","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_5","unstructured":"Wessendorp, N., Dinaux, R., Dupeyroux, J., and de Croon, G.C.H.E. (October, January 27). Obstacle Avoidance onboard MAVs using a FMCW Radar. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic."},{"key":"ref_6","unstructured":"Hansen, H.J. (2006). Collision Avoidance W-Band FMCW Radars in an Altimeter Application, Defence Science and Technology Organisation Edinburgh (Australia) Electronic Warfare and Radar Divisionaustralia."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1109\/TMTT.2021.3121746","article-title":"A SiGe-Chip-Based D-Band FMCW-Radar Sensor with 53-GHz Tuning Range for High Resolution Measurements in Industrial Applications","volume":"70","author":"Hansen","year":"2022","journal-title":"IEEE Trans. Microwave Theory Techn."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"20447","DOI":"10.1109\/JSEN.2021.3095674","article-title":"Cost-Efficient FMCW Radar for Multi-Target Classification in Security Gate Monitoring","volume":"21","author":"Rizik","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_9","unstructured":"(2022, September 28). Eurostat\u2013Accidents at Work Statistics\u2013Statistics Explained. Available online: https:\/\/ec.europa.eu\/eurostat\/statistics-explained\/index.php?title=Accidents_at_work_statistics#Number_of_accidents."},{"key":"ref_10","first-page":"309","article-title":"Behavioural impacts of Advanced Driver Assistance Systems\u2014An overview","volume":"1","author":"Brookhuis","year":"2001","journal-title":"Eur. J. Transp. Infrastruct. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"258-1","DOI":"10.2352\/ISSN.2470-1173.2018.17.AVM-258","article-title":"Camera radar fusion for increased reliability in ADAS","volume":"2018","author":"Zhong","year":"2018","journal-title":"Electron. Imaging"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015). Fast R-CNN. arXiv.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2015). Rich feature hierarchies for accurate object detection and semantic segmentation Tech report (v5). arXiv.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_14","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Shuai, X., Shen, Y., Tang, Y., Shi, S., Ji, L., and Xing, G. (2021, January 18\u201321). milliEye: A Lightweight mmWave Radar and Camera Fusion System for Robust Object Detection. Proceedings of the IoTDI \u201821: International Conference on Internet-of-Things Design and Implementation, Nashville, TN, USA.","DOI":"10.1145\/3450268.3453532"},{"key":"ref_16","unstructured":"(2023, April 15). Texas Instruments-Introduction to mmWave Radar Sensing: FMCW Radars. Available online: https:\/\/training.ti.com\/node\/1139153."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/TAES.2006.1603402","article-title":"Micro-Doppler effect in radar: Phenomenon, model, and simulation study","volume":"42","author":"Chen","year":"2006","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Govoni, M.A. (2017, January 8\u201312). Micro-Doppler Signal Decomposition of Small Commercial Drones. Proceedings of the IEEE Radar Conference (RadarConf), Seattle, WA, USA.","DOI":"10.1109\/RADAR.2017.7944240"},{"key":"ref_19","unstructured":"(2023, April 25). Texas Instruments\u2014Advanced Driver Assistance Systems (ADAS). Available online: https:\/\/www.ti.com\/applications\/automotive\/adas\/overview.html."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Bochkovskiy, A., and Liao, M.H.-Y. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.","DOI":"10.1109\/CVPR52729.2023.00721"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2016). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv.","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"ref_22","unstructured":"(2022, December 22). Ultralytics\u2013YOLOv5 in PyTorch > ONNX > CoreML > TFLite. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_23","unstructured":"Lamane, M. (2023, May 22). AWR2944 mmWave Radar Dataset for YOLOv7. Available online: https:\/\/kaggle.com\/datasets\/a0a79ed59cce71bb788a634d130b5daf1d66b0c6f98ce34a5f9f46a24e02f5d6."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2509810","DOI":"10.1109\/TIM.2022.3176014","article-title":"A mmWave-YOLO: A mmWave Imaging Radar-Based Real-Time Multiclass Object Recognition System for ADAS Applications","volume":"71","author":"Kosuge","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, Z., Miao, X., Huang, Z., and Luo, H. (2021). Research of target detection and classification techniques using millimeter-wave radar and vision sensors. Remote Sens., 13.","DOI":"10.3390\/rs13061064"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"19993","DOI":"10.1109\/JSEN.2021.3092583","article-title":"Target Classification by mmWave FMCW Radars Using Machine Learning on Range-Angle Images","volume":"21","author":"Gupta","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kim, W., Cho, H., Kim, J., Kim, B., and Lee, S. (2020). YOLO-Based Simultaneous Target Detection and Classification in Automotive FMCW Radar Systems. Sensors, 20.","DOI":"10.3390\/s20102897"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, A., Nowruzi, F.E., and Laganiere, R. (2021, January 26\u201328). RADDet: Range-Azimuth-Doppler based Radar Object Detection. Proceedings of the 18th Conference on Robots and Vision (CRV), Burnaby, BC, Canada.","DOI":"10.1109\/CRV52889.2021.00021"},{"key":"ref_29","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Pandya, A., Jha, A., and Cenkeramaddi, L.R. (2021). A velocity estimation technique for a monocular camera using mmwave fmcw radars. Electronics, 10.","DOI":"10.3390\/electronics10192397"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"15435","DOI":"10.1109\/JSEN.2022.3167251","article-title":"MS-YOLO: Object Detection Based on YOLOv5 Optimized Fusion Millimeter-Wave Radar and Machine Vision","volume":"22","author":"Song","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Arab, H., Ghaffari, I., Chioukh, L., Tatu, S., and Dufour, S. (2021). Machine Learning Based Object Classification and Identification Scheme Using an Embedded Millimeter-Wave Radar Sensor. Sensors, 21.","DOI":"10.3390\/s21134291"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"88917","DOI":"10.1109\/ACCESS.2019.2926381","article-title":"Acceleration of FPGA based convolutional neural network for human activity classification using millimeter-wave radar","volume":"7","author":"Lei","year":"2021","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Abdu, F.J., Zhang, Y., Fu, M., Li, Y., and Deng, Z. (2021). Application of deep learning on millimeter-wave radar signals: A review. Sensors, 21.","DOI":"10.3390\/s21061951"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bhatia, J., Dayal, A., Jha, A., Vishvakarma, S.K., Joshi, S., Srinivas, M.B., and Cenkeramaddi, L.R. (2021). Classification of targets using statistical features from range fft of mmwave fmcw radars. Electronics, 10.","DOI":"10.3390\/electronics10161965"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1016\/j.procs.2022.07.056","article-title":"Classification of targets detected by mmWave radar using YOLOv5","volume":"203","author":"Lamane","year":"2022","journal-title":"Procedia Comput. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1177\/02783649211068535","article-title":"ColoRadar: The direct 3D millimeter wave radar dataset","volume":"41","author":"Kramer","year":"2022","journal-title":"Int. J. Robot. Res."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1049\/ip-f-2.1992.0048","article-title":"Linear FMCW radar techniques","volume":"139","author":"Stove","year":"1992","journal-title":"IEE Proc. F (Radar Signal Process.)"},{"key":"ref_39","unstructured":"Jankiraman, M. (2018). FMCW Radar Design, Artech House."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Cardillo, E., Li, C., and Caddemi, A. (2020, January 3\u20135). Empowering Blind People Mobility: A Millimeter-Wave Radar Cane. Proceedings of the 2020 IEEE International Workshop on Metrology for Industry 4.0 & IoT, Rome, Italy.","DOI":"10.1109\/MetroInd4.0IoT48571.2020.9138239"},{"key":"ref_41","unstructured":"(2023, May 05). Texas Instruments\u2013High-End Corner Radar Reference Design. Available online: https:\/\/www.ti.com\/document-viewer\/lit\/html\/TIDUF01\/GUID-06B9570A-5AA4-45EE-9D97-A62DB40A1381#GUID-12646A4E-2CD9-43ED-B442-4730AE6F2738."},{"key":"ref_42","unstructured":"(2023, May 05). Texas Instruments\u2013AWR2944 Single-Chip 76- and 81-GHz FMCW Radar Sensor. Available online: https:\/\/www.ti.com\/document-viewer\/lit\/html\/swrs273."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18\u201323). Path Aggregation Network for Instance Segmentation. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00913"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2018). Image-to-image translation with conditional adversarial networks. arXiv.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_45","unstructured":"Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). YOLOX: Exceeding YOLO series in 2021. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/23\/9456\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:32:02Z","timestamp":1760131922000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/23\/9456"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,28]]},"references-count":45,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["s23239456"],"URL":"https:\/\/doi.org\/10.3390\/s23239456","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,28]]}}}