{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T06:47:19Z","timestamp":1762325239780,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,2,9]],"date-time":"2022-02-09T00:00:00Z","timestamp":1644364800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent years, neural networks have exploded in popularity, revolutionizing the domains of computer vision, natural language processing, and autonomous systems. This is due to neural networks ability to approximate complex non-linear functions. Despite their effectiveness, they generally require large labeled data sets and considerable processing power for both training and prediction. Some of these bottlenecks have been mitigated by recent increased availability of high-quality data sets, improvements in neural network development software, and greater hardware support. Due to algorithmic bloat, neural network inference times and imprecision make them undesirable for some problems where fast classical algorithm solutions already exist, other classes of algorithms, such as convex optimization, with non-trivial execution times could be reduced using neural solutions. These algorithms could be replaced with light-weight neural networks, benefiting from their high degree of parallelization and high accuracy when properly trained. Previous work has explored how low size, weight, and power (low SWaP) neural networks and neuromorphic computing can be used to improve autonomous radar waveform design techniques that currently rely on convex optimization. Autonomous radar waveform design helps meet the need for interference mitigation caused by an ever-growing number of consumer and commercial technologies which pollute the radio frequency (RF) spectrum. Spectral notching, a radar waveform design technique, augments transmitted radar waveforms to avoid frequencies with excessive interference while maintaining the integrity of the waveform. In this paper, we extend that work, demonstrating that lean neural networks and specialized hardware can improve inference time for waveform design without sacrificing accuracy. Our lean neural solution incorporates problem-specific information into the layer structures and loss functions to decrease network size and improve accuracy. We provide model outcomes implemented on radio frequency system on a chip (RFSoC) hardware that support our simulation results. Our neural network solution decreases inference time on traditional CPU hardware by 1057\u00d7 and on GPU hardware accelerators by 883\u00d7 while maintaining 99% cosine similarity.<\/jats:p>","DOI":"10.3390\/s22041317","type":"journal-article","created":{"date-parts":[[2022,2,9]],"date-time":"2022-02-09T21:26:48Z","timestamp":1644442008000},"page":"1317","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Lean Neural Networks for Autonomous Radar Waveform Design"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8769-4548","authenticated-orcid":false,"given":"Anthony","family":"Baietto","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, The Ohio State University, Columbus, OH 43210, USA"},{"name":"Applied Research Solutions, Beavercreek, OH 45440, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jayson","family":"Boubin","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, The Ohio State University, Columbus, OH 43210, USA"},{"name":"Applied Research Solutions, Beavercreek, OH 45440, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick","family":"Farr","sequence":"additional","affiliation":[{"name":"Applied Research Solutions, Beavercreek, OH 45440, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Trevor J.","family":"Bihl","sequence":"additional","affiliation":[{"name":"Sensors Directorate, Air Force Research Laboratory, Wright-Patterson Air Force Base, OH 45433, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aaron M.","family":"Jones","sequence":"additional","affiliation":[{"name":"Sensors Directorate, Air Force Research Laboratory, Wright-Patterson Air Force Base, OH 45433, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christopher","family":"Stewart","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, The Ohio State University, Columbus, OH 43210, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,9]]},"reference":[{"key":"ref_1","unstructured":"Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y. (2016). Deep Learning, MIT Press."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1613\/jair.4992","article-title":"A primer on neural network models for natural language processing","volume":"57","author":"Goldberg","year":"2016","journal-title":"J. Artif. Intell. Res."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lin, S.C., Zhang, Y., Hsu, C.H., Skach, M., Haque, M.E., Tang, L., and Mars, J. (2018, January 24\u201328). The architectural implications of autonomous driving: Constraints and acceleration. Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems, Williamsburg, VA, USA.","DOI":"10.1145\/3173162.3173191"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bihl, T., Schoenbeck, J., Steeneck, D., and Jordan, J. (2020, January 7\u201310). Easy and Efficient Hyperparameter Optimization to Address Some Artificial Intelligence \u201cilities\u201d. Proceedings of the 53rd Hawaii International Conference on System Sciences, HICSS 2020, Maui, HI, USA.","DOI":"10.24251\/HICSS.2020.118"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft coco: Common objects in context. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The kitti dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bisong, E. (2019). Google colaboratory. Building Machine Learning and Deep Learning Models on Google Cloud Platform, Apress.","DOI":"10.1007\/978-1-4842-4470-8"},{"key":"ref_10","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), Savannah, GA, USA."},{"key":"ref_11","unstructured":"Collobert, R., Bengio, S., and Mari\u00e9thoz, J. (2002). Torch: A Modular Machine Learning Software Library, Idiap. Technical Report."},{"key":"ref_12","unstructured":"Chollet, F. (2021, December 28). Keras. Available online: https:\/\/keras.io."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Jouppi, N.P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., and Borchers, A. (2017, January 24\u201328). In-datacenter performance analysis of a tensor processing unit. Proceedings of the 44th Annual International Symposium on Computer Architecture, Toronto, ON, Canada.","DOI":"10.1145\/3079856.3080246"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Markidis, S., Der Chien, S.W., Laure, E., Peng, I.B., and Vetter, J.S. (2018, January 21\u201325). Nvidia tensor core programmability, performance & precision. Proceedings of the 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), Vancouver, BC, Canada.","DOI":"10.1109\/IPDPSW.2018.00091"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_16","unstructured":"Schuman, C.D., Potok, T.E., Patton, R.M., Birdwell, J.D., Dean, M.E., Rose, G.S., and Plank, J.S. (2017). A survey of neuromorphic computing and neural networks in hardware. arXiv."},{"key":"ref_17","unstructured":"LeCun, Y., Cortes, C., and Burges, C. (2021, December 28). MNIST Handwritten Digit Database. Available online: http:\/\/yann.lecun.com\/exdb\/mnist."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s42064-017-0003-8","article-title":"Survey of Convex Optimization for Aerospace Applications","volume":"1","author":"Liu","year":"2017","journal-title":"Astrodynamics"},{"key":"ref_19","unstructured":"Lobo, M.S. (2000). Robust and Convex Optimization with Applications in Finance. [Ph.D. Thesis, Stanford University]."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.1109\/TPWRS.2020.3018869","article-title":"Convex Optimization of Integrated Power-Gas Energy Flow Model With Applications to Probabilistic Energy Flow","volume":"36","author":"Jia","year":"2021","journal-title":"IEEE Trans. Power Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2758","DOI":"10.1364\/AO.21.002758","article-title":"Phase retrieval algorithms: A comparison","volume":"21","author":"Fienup","year":"1982","journal-title":"Appl. Opt."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1049\/iet-rsn.2013.0194","article-title":"Mitigating interference via spatial and spectral nulling","volume":"8","author":"Higgins","year":"2014","journal-title":"IET Radar Sonar Navig."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Boubin, J., Jones, A.M., and Bihl, T. (2019, January 4\u20136). NeuroWav: Toward Real-Time Waveform Design for VANETs using Neural Networks. Proceedings of the 2019 IEEE Vehicular Networking Conference (VNC), Los Angeles, CA, USA.","DOI":"10.1109\/VNC48660.2019.9062792"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1109\/TNET.2020.3009425","article-title":"Detecting IoT Devices in the Internet","volume":"28","author":"Guo","year":"2020","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_25","first-page":"237","article-title":"A practical algorithm for the determination of phase from image and diffraction plane pictures","volume":"35","author":"Gerchberg","year":"1972","journal-title":"Optik"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"7823","DOI":"10.1109\/ACCESS.2018.2890150","article-title":"FPGA-based Accelerators of Deep Learning Networks for Learning and Classification: A Review","volume":"7","author":"Shawahna","year":"2019","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/MM.2018.022071136","article-title":"An All-Programmable 16-nm RFSoC for Digital-RF Communications","volume":"38","author":"Farley","year":"2018","journal-title":"IEEE Micro"},{"key":"ref_28","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"John-Baptiste, P., Smith, G.E., Jones, A.M., and Bihl, T. (2019, January 15\u201318). Rapid Waveform Design Through Machine Learning. Proceedings of the 2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), Le Gosier, France.","DOI":"10.1109\/CAMSAP45676.2019.9022492"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Farr, P., Jones, A.M., Bihl, T., Boubin, J., and DeMange, A. (2020, January 28\u201330). Waveform Design Implemented on Neuromorphic Hardware. Proceedings of the 2020 IEEE International Radar Conference (RADAR), Washington, DC, USA.","DOI":"10.1109\/RADAR42522.2020.9114635"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Boubin, J.G., Babu, N.T., Stewart, C., Chumley, J., and Zhang, S. (2019, January 7\u20139). Managing edge resources for fully autonomous aerial systems. Proceedings of the 4th ACM\/IEEE Symposium on Edge Computing, Arlington, VA, USA.","DOI":"10.1145\/3318216.3363306"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/4\/1317\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:16:57Z","timestamp":1760134617000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/4\/1317"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,9]]},"references-count":31,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22041317"],"URL":"https:\/\/doi.org\/10.3390\/s22041317","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,2,9]]}}}